-- Logs begin at Tue 2022-09-06 22:04:19 UTC, end at Tue 2022-09-06 23:02:39 UTC. -- Sep 06 22:34:13.854434 dv-cinder-852208-20-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 06 22:34:13.864301 dv-cinder-852208-20-iscsi devstack@n-api.service[112112]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 06 22:34:13.866314 dv-cinder-852208-20-iscsi devstack@n-api.service[112112]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 6 22:34:13 2022] *** Sep 06 22:34:13.866314 dv-cinder-852208-20-iscsi devstack@n-api.service[112112]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 06 22:34:13.866314 dv-cinder-852208-20-iscsi devstack@n-api.service[112112]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 06 22:34:13.866314 dv-cinder-852208-20-iscsi devstack@n-api.service[112112]: nodename: dv-cinder-852208-20-iscsi Sep 06 22:34:13.866314 dv-cinder-852208-20-iscsi devstack@n-api.service[112112]: machine: x86_64 Sep 06 22:34:13.866314 dv-cinder-852208-20-iscsi devstack@n-api.service[112112]: clock source: unix Sep 06 22:34:13.866314 dv-cinder-852208-20-iscsi devstack@n-api.service[112112]: pcre jit disabled Sep 06 22:34:13.866314 dv-cinder-852208-20-iscsi devstack@n-api.service[112112]: detected number of CPU cores: 4 Sep 06 22:34:13.866314 dv-cinder-852208-20-iscsi devstack@n-api.service[112112]: current working directory: / Sep 06 22:34:13.866314 dv-cinder-852208-20-iscsi devstack@n-api.service[112112]: detected binary path: /usr/bin/uwsgi-core Sep 06 22:34:13.866983 dv-cinder-852208-20-iscsi devstack@n-api.service[112112]: your processes number limit is 47680 Sep 06 22:34:13.866983 dv-cinder-852208-20-iscsi devstack@n-api.service[112112]: your memory page size is 4096 bytes Sep 06 22:34:13.866983 dv-cinder-852208-20-iscsi devstack@n-api.service[112112]: detected max file descriptor number: 2048 Sep 06 22:34:13.866983 dv-cinder-852208-20-iscsi devstack@n-api.service[112112]: lock engine: pthread robust mutexes Sep 06 22:34:13.866983 dv-cinder-852208-20-iscsi devstack@n-api.service[112112]: thunder lock: enabled Sep 06 22:34:13.866983 dv-cinder-852208-20-iscsi devstack@n-api.service[112112]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 06 22:34:13.866983 dv-cinder-852208-20-iscsi devstack@n-api.service[112112]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 06 22:34:13.906594 dv-cinder-852208-20-iscsi devstack@n-api.service[112112]: Python main interpreter initialized at 0x5633018e19c0 Sep 06 22:34:13.906594 dv-cinder-852208-20-iscsi devstack@n-api.service[112112]: python threads support enabled Sep 06 22:34:13.906594 dv-cinder-852208-20-iscsi devstack@n-api.service[112112]: your server socket listen backlog is limited to 100 connections Sep 06 22:34:13.906594 dv-cinder-852208-20-iscsi devstack@n-api.service[112112]: your mercy for graceful operations on workers is 90 seconds Sep 06 22:34:13.906937 dv-cinder-852208-20-iscsi devstack@n-api.service[112112]: mapped 403077 bytes (393 KB) for 2 cores Sep 06 22:34:13.907012 dv-cinder-852208-20-iscsi devstack@n-api.service[112112]: *** Operational MODE: preforking *** Sep 06 22:34:13.907243 dv-cinder-852208-20-iscsi devstack@n-api.service[112112]: *** uWSGI is running in multiple interpreter mode *** Sep 06 22:34:13.907243 dv-cinder-852208-20-iscsi devstack@n-api.service[112112]: spawned uWSGI master process (pid: 112112) Sep 06 22:34:13.907428 dv-cinder-852208-20-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 06 22:34:13.908802 dv-cinder-852208-20-iscsi devstack@n-api.service[112112]: spawned uWSGI worker 1 (pid: 112113, cores: 1) Sep 06 22:34:13.909118 dv-cinder-852208-20-iscsi devstack@n-api.service[112112]: spawned uWSGI worker 2 (pid: 112114, cores: 1) Sep 06 22:34:13.911209 dv-cinder-852208-20-iscsi devstack@n-api.service[112112]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 06 22:34:14.568666 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 06 22:34:14.583761 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 06 22:34:15.649935 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 22:34:15.649935 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: from cryptography.utils import int_from_bytes Sep 06 22:34:15.650470 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 22:34:15.650470 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: from cryptography.utils import int_from_bytes Sep 06 22:34:15.657101 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 22:34:15.657101 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: from cryptography.utils import int_from_bytes Sep 06 22:34:15.657530 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 22:34:15.657530 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: from cryptography.utils import int_from_bytes Sep 06 22:34:18.127153 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 22:34:18.127716 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 22:34:18.127920 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 22:34:18.128845 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 22:34:18.129071 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 22:34:18.129452 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.129771 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.130088 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.130399 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.130719 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.131025 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.131338 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.131651 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.131971 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.132227 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.132533 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.132878 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-20-iscsi {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.133198 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.133501 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.133802 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.134112 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.134409 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.134724 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.135023 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.135418 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 22:34:18.135767 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.135853 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 22:34:18.135991 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.136197 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 22:34:18.136321 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.136542 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.136662 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 22:34:18.136813 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 22:34:18.136945 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.137191 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.137281 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.137495 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.137582 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.137808 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.137902 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.138110 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.138205 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.138424 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.138511 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.138981 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.139075 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.139302 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.139394 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-20-iscsi {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.139619 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.139712 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.139943 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.140094 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.140212 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.140364 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.140492 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.140655 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.140830 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-20-iscsi {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.140984 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.141150 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.141286 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.141454 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.141598 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.141761 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.141912 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.142075 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.142213 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.142376 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.142517 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.142692 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.142828 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.143003 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.143140 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.143452 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.143610 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.143871 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.144472 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.144706 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.145037 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.145222 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.145404 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.145540 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.145633 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.145876 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.145962 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.146157 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.146241 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.146457 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.146551 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.146771 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.146865 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.147086 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.147170 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.147398 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.147487 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.147644 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.147739 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.147889 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.148079 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-20-iscsi {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.148201 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.148392 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.148511 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.148700 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.148818 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.149037 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.149137 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.149406 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.149498 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.149704 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.149798 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.150001 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.150087 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.150296 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.150400 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.150593 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.150680 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.150894 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.150992 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.151202 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.151298 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.151506 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.151592 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.151817 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.151910 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.152115 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.152209 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.152423 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.152508 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.152724 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.152841 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.153053 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.153157 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.153351 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.153436 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.153655 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.153789 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.153961 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.154055 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.154207 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.154294 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.154509 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.154595 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.154822 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.154917 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.155137 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.155224 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.155433 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.155518 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.155691 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.155777 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.155937 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.156024 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.156251 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.156345 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.156564 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.156651 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.156868 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.156974 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.157163 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.157266 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.157458 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.157552 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.157756 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.157841 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.158052 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.158146 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.158349 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.158435 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.158644 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.158729 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.158935 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.159022 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.159231 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.159318 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.159606 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.159917 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.160056 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.160215 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.160398 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.160511 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.160714 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.160815 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.161065 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.161153 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.161402 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.161488 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.161700 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.161792 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.161995 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.162082 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.162304 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.162390 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.162615 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.162708 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.162913 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.163000 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.163208 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.163303 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.163504 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.163605 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.163801 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.163972 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.164112 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.164198 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.164409 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.164502 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.164705 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.164848 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.165045 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.165133 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.165342 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.165442 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.165589 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.165683 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.165888 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.165981 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.166218 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.166312 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.166515 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.166601 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.166823 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.166920 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.167115 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.167220 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.167411 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.167511 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.167717 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.167803 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.168013 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.168149 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.168307 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.168402 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.168601 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.168688 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.168922 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.169011 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.169219 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.169317 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.169513 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.169607 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.169806 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.169901 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.170099 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.170185 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.170394 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.170528 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.170694 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.170822 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.171002 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.171095 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.171302 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.171395 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.171597 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.171692 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.171891 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.171994 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.172189 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.172275 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.172491 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.172585 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.172837 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.172928 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.173143 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.173228 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.173447 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.173535 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.173768 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.173854 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.174071 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.174165 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.174372 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.174458 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.174680 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.174779 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.175122 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.175234 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.175340 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.175645 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.175805 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.175949 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.176133 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.176279 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.176439 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.176548 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.176748 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.176881 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.177092 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.177192 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.177399 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.177486 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.177703 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.177795 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.178006 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.178099 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.178309 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.178396 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.178610 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.178707 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.178911 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.178998 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.179211 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.179297 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.179512 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.179598 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.179810 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.179905 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.180124 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.180216 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.180440 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.180533 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.180745 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.180857 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.181071 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.181159 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.181372 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.181468 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.181687 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:34:18.181782 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.182013 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.182107 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.182341 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.182434 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.182644 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.182730 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.182950 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.183037 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.183263 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.183361 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.183567 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.183662 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.183883 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.183970 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.184190 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.184285 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.184493 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.184581 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.184817 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.184909 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.185131 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.185231 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.185437 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.185524 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.185741 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.185872 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.186056 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.186153 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.186370 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.186457 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.186677 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.186763 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.186982 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.187070 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.187292 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.187376 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.187594 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.187679 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.187898 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.187985 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.188200 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.188295 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.188497 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.188584 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.188813 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.188915 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.189115 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.189202 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.189416 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.189503 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.189714 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.189802 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.190026 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.190112 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.190343 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.190441 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.191167 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.191314 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.191552 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.191858 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.192005 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.192164 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.192320 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.192468 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.192631 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.192811 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.193002 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.193106 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.193317 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.193404 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.193628 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.193715 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.193946 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.194109 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.194256 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.194334 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.194558 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.194643 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.194855 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.194952 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.195171 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.195319 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.195476 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.195563 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.195776 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.195870 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.196084 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.196181 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.196389 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.196477 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.196693 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.196794 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.197023 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.197111 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.197326 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.197412 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.197641 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.197736 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.197944 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.198031 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.198247 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.198346 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.198554 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.198639 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.198862 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.198948 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.199166 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.199264 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.199468 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.199554 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.199772 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.199858 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.200078 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.200177 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.200374 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.200459 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.200676 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.200791 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.200996 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.201093 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.201297 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.201398 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.201591 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.201679 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.201893 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.201992 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.202188 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.202276 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.202484 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.202570 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.202780 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.202868 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.203076 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.203162 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.203373 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.203460 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.203676 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.203762 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.203977 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.204062 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.204274 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.204406 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.204570 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.204659 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.204892 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.204984 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.205213 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.205299 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.205516 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.205605 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.205820 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.205906 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.206132 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.206838 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.207150 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.207476 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.207571 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.207785 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.207880 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.208096 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.208184 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.208401 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.208487 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.208706 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.208820 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.209036 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.209124 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.209340 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.209426 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.209653 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.209743 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.209958 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.210045 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.210269 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.210355 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.210573 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.210673 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.210891 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.210977 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.211194 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.211282 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.211499 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.211596 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.211796 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.211882 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.212094 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.212179 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.212398 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.212493 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.212699 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.212808 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.213029 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.213116 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.213333 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.213432 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.213636 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.213731 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.213938 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.214031 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.214239 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.214326 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.214540 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.214614 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.214847 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.214989 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.215149 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.215243 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.215449 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.215534 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.215753 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.215838 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.216053 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.216206 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.216353 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.216439 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.216668 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.216803 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.216995 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.217084 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.217305 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.217392 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.217602 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.217697 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.217908 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.217996 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.218229 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.218324 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.218555 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.218651 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.218859 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.218947 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.219164 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.219249 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.219470 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.219569 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.219772 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.219857 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.220075 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.220162 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.220379 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.220473 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.220675 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.220791 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.220998 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.221087 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.221301 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.221396 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.221609 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.221699 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.222006 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.222116 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.222252 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.222552 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.222699 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.222859 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.223019 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.223160 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.223359 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.223449 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.223691 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.223778 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.224009 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.224096 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.224338 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.224432 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.224643 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.224736 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.224978 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.225085 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.225289 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.225378 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.225594 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.225679 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.225891 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.225986 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.226196 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.226282 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.226497 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.226591 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.226794 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.226893 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.227092 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.227180 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.227388 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.227482 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.227710 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.227803 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.228014 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.228110 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.228312 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.228399 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.228617 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.228720 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.228954 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.229051 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.229254 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.229340 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.229562 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.229650 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.229865 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.229953 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.230165 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.230252 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.230480 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.230567 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.230785 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.230872 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.231087 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.231175 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.231390 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.231479 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.231691 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.231793 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.231992 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.232077 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.232294 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.232389 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.232605 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.232690 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.232937 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.233038 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.233246 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.233332 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.233548 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.233634 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.233844 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.233938 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.234148 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.234236 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.234447 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.234532 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.234748 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.235005 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.235336 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.235419 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.235643 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.235737 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.235955 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.236050 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.236291 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.236388 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.236603 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.236691 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.236930 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.237037 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.237238 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.237326 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.237601 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.237763 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.237938 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.238243 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.238404 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.238545 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.238715 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.238843 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.239023 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.239147 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.239330 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.239444 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.239674 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.239762 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.239985 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.240080 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.240290 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.240377 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.240598 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.240684 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.240939 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.241045 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.241240 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.241327 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.241539 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.241626 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.241846 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.241939 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.242146 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.242232 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.242449 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.242536 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.242747 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.242835 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.243054 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.243141 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.243353 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.243438 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.243649 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.243747 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.243947 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.244035 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.244244 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.244333 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.244566 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.244652 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.244886 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.244967 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.245193 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.245280 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.245500 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.245588 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.245803 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.245891 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.246109 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.246203 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.246424 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.246510 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.246740 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.246979 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.247066 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.247308 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.247396 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.247609 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.247694 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.247911 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.247998 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.248213 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.248301 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.248509 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.248604 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.248840 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.248943 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.249146 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.249249 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.249449 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.249537 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.249749 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.249836 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.250043 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.250139 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.250343 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.250431 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.250640 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.250727 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.250971 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.251072 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.251243 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.251330 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.251539 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.251624 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.251835 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.251923 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.252137 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.252225 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.252436 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.252521 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.252731 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.252845 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.253055 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.253660 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.253889 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.254371 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.254467 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.254676 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.254772 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.254977 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.255106 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.255277 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.255373 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.255581 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.255668 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.255883 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.255970 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.256186 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.256274 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.256487 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.256572 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.256811 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.256901 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.257112 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.257200 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.257411 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.257506 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.257712 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.257799 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.258008 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.258096 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.258304 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.258398 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.258605 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.258705 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.258920 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.259008 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.259231 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.259318 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.259528 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.259624 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.259829 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.259917 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.260126 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.260221 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.260425 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.260524 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.260720 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.260854 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.261045 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.261142 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.261341 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.261438 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.261637 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.261725 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.261933 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.262020 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.262229 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.262318 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.262525 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.262623 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.262839 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.262932 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.263140 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.263228 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.263438 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.263566 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.263985 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.264074 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.264285 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.264375 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.264609 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.264702 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.264935 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.265024 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.265246 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.265337 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.265553 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.265640 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.265858 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.265957 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.266165 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.266259 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.266468 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.266554 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.266774 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.266869 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.267083 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.267171 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.267380 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.267468 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.267688 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.267784 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.267991 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.268087 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.268298 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.268386 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.268595 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.268691 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.269656 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.269982 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.270068 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.270291 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.270378 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.270599 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.270688 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.270915 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.271002 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.271234 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.271329 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.271552 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.271640 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.271851 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.271945 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.272154 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.272254 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.272457 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.272551 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.272777 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.272868 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.273086 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.273186 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.273390 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.273479 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.273692 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.273779 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.273995 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.274090 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.274297 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.274385 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.274599 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.274685 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.274899 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.274993 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.275196 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.275330 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.275498 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.275585 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.275798 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.275885 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.276092 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.276178 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.276409 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.276502 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.276708 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.276823 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.277031 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.277120 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.277332 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.277418 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.277628 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.277717 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.277930 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.278017 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.278229 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.278325 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.278600 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.278692 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.278907 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.278995 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.279220 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.279320 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.279516 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.279602 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.279820 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.279908 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.280122 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.280218 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.280430 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.280516 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.280733 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.280884 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.281053 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.281152 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.281361 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.281448 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.281674 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.281761 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.281974 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.282063 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.282277 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.282364 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.282595 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.282683 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.282904 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.282997 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.283206 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.283301 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.283523 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.283615 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.283821 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.283910 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.284120 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.284207 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.284459 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.284550 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.284975 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.285066 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.285295 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.285431 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.285606 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.285703 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.285917 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.286118 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.286227 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.286433 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.286521 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.286737 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.286863 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.287130 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.287215 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.287437 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.287529 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.287739 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.287828 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.288057 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.288172 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.288374 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.288492 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.288692 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.288822 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.289017 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.289116 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.289325 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.289423 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.289628 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.289716 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.289944 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.290038 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.290260 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.290359 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.290565 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.290652 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.290870 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.290957 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.291168 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.291263 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.291481 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.291571 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.291796 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.291884 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.292105 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.292240 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.292424 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.292512 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.292750 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.292848 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.293094 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.293183 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.293407 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.293495 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.293718 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.293805 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.294019 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.294128 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.294338 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.294426 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.294638 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.294726 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.294943 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.295031 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.295240 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.295328 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.295539 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.295616 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.295854 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.295941 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.296157 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.296246 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.296460 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.296547 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.296802 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.296908 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.297087 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.297174 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.297383 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.297469 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.297679 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.297779 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.297986 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.298072 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.298279 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.298365 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.298592 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.298692 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.298901 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.298989 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.299219 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.299306 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.299532 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.299679 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.299832 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.300600 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.300714 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.301083 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.301287 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.301390 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.301616 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.301705 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.301919 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.302005 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.302256 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.302392 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.302554 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.302641 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.302868 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.302961 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.303178 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.303267 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.303501 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.303595 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.303807 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.303895 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.304116 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.304203 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.304428 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.304516 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.304733 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.304909 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.305062 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.305152 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.305373 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.305462 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.305693 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.305795 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.305994 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.306082 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.306292 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.306467 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.306600 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.306793 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.306882 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.307104 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.307193 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.307424 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.307522 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.307747 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.307836 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.308042 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.308128 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.308337 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.308425 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.308633 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.308722 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.308958 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.309046 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.309258 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.309357 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.309574 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.309670 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.309875 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.309961 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.310170 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.310265 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.310469 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.310557 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.310765 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.310852 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.311068 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.311166 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.311373 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.311468 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.311687 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.311774 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.311988 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.312082 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.312305 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.312403 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.312616 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.312703 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.312947 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.313035 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.313259 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.313347 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.313564 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.313662 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.313869 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.313956 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.314176 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.314264 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.314476 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.314576 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.314776 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.314864 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.315076 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.315172 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.315384 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.315477 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.316273 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.316522 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.316820 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.317099 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.317186 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.317436 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.317524 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.317745 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.317833 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.318055 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.318143 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.318365 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.318454 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.318676 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.318765 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.318984 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.319071 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.319290 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.319379 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.319596 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.319691 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.319902 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.319998 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.320219 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.320306 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.320528 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.320614 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.320870 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.320981 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.321177 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.321263 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.321484 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.321571 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.321790 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.321886 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.322099 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.322186 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.322405 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.322493 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.322708 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.322802 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.323012 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.323099 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.323333 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.323427 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.323640 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.323728 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.323948 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.324041 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.324256 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.324343 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.324559 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.324647 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.324885 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.324977 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.325188 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.325353 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.325492 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.325579 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.325797 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.325886 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.326099 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.326196 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.326407 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.326543 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.326719 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.326807 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.327036 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.327136 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.327347 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.327433 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.327661 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.327749 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.327966 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.328060 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.328275 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.328369 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.328585 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.328671 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.328919 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.329115 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.329229 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.329422 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.329543 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.329747 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.329848 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.330065 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.330153 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.330382 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.330661 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.330748 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.330983 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.331075 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.331869 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.331964 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.332238 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.332544 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.332679 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.332875 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.332978 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.333183 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.333270 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.333484 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.333574 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.333802 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.333889 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.334108 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.334202 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.334408 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.334497 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.334721 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.334809 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.335025 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.335112 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.335373 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.335547 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.335702 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.335883 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.336037 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.336191 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.336355 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.336511 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.336669 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.336856 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.337004 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.337170 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.337318 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.337471 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.337673 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.337791 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.337985 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.338094 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.338290 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.338378 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.338603 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.338690 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.338917 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.339012 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.339228 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.339315 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.339538 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.339626 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.339842 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.339936 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.340143 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.340238 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.340441 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.340536 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.340746 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.340891 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.341068 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.341156 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.341375 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.341470 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.341674 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.341761 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.341974 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.342062 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.342273 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.342374 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.342577 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.342671 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.342877 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.342965 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.343175 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.343270 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.343472 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.343561 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.343769 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.344014 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.344102 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.344325 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.344420 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.344649 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.344735 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.344972 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.345081 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.345279 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.345367 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.345607 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.345693 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.345910 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.346005 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.346208 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.346297 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.346526 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.346619 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.346824 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.347109 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.347218 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.347682 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.347775 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.347998 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.348087 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.348308 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.348397 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.348617 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.348704 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.348950 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.349053 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.349254 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.349340 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.349576 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.349663 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.349885 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.350103 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.350413 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.350501 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.350737 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.350823 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.351060 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.351203 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.351383 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.351471 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.351685 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.351772 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.351988 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.352084 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.352290 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.352379 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.352610 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.352695 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.352939 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.353035 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.353241 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.353327 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.353543 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.353629 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.353850 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.353945 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.354151 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.354237 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.354454 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.354540 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.354759 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.354855 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.355062 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.355149 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.355365 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.355461 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.355667 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.355755 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.355966 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.356059 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.356265 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.356359 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.356569 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.356657 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.356893 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.356992 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.357197 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.357298 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.357505 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.357652 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.357807 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.357891 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.358097 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.358194 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.358399 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.358486 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.358700 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.358787 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.359009 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.359096 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.359310 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.359396 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.359614 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.359708 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.359912 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.359999 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.360220 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.360307 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.360544 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.360633 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.360874 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.360964 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.361176 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.361262 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.361498 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.361801 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.361889 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.362103 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.362189 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.362415 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.363033 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.363393 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.363665 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.363752 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.363996 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.364086 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.364312 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.364413 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.364619 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.364708 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.364974 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.365076 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.365280 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.365378 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.365603 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.365815 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.365936 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.366147 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.366243 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.366468 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.366556 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.366796 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.366922 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.367125 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.367221 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.367430 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.367516 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.367731 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.367812 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.368040 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.368135 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.368342 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.368430 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.368638 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.368725 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.368961 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.369052 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.369266 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.369354 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.369563 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.369651 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.369860 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.369949 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.370158 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.370245 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.370454 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.370547 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.370753 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.370841 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.371048 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.371136 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.371345 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.371432 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.371641 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.371729 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.371938 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.372025 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.372235 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.372332 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.372531 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.372620 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.372851 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.372942 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.373148 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.373295 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.373445 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.373534 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.373739 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.373833 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.374037 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.374136 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.374333 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.374420 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.374657 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.374751 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.374968 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.375055 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.375275 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.375368 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.375579 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.375664 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.375881 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.375968 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.376195 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.376289 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.376495 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.376588 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.376830 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.376920 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.377150 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.377504 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.377599 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.377762 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.377859 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.378106 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.378218 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.378622 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.378709 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.379028 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.379136 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.379360 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.379449 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.379682 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.379770 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.379989 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.380079 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.380296 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.380384 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.380603 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.380689 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.380952 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.381041 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.381256 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.381346 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.381575 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.381676 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.381886 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.381982 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.382195 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.382281 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.382499 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.382600 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.382802 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.382888 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.383106 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.383192 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.383417 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.383512 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.383722 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.383815 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.384022 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.384120 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.384320 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.384407 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.384621 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.384707 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.384946 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.385045 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.385254 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.385349 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.385555 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.385642 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.385856 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.385952 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.386161 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.386252 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.386460 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.386554 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.386762 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.386849 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.387062 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.387150 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.387362 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.387449 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.387662 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.387807 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.387962 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.388052 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.388266 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.388361 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.388564 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.388659 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.389152 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.389254 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.389454 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.389542 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.389754 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.389854 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.390054 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.390142 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.390320 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112114) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 22:34:18.390406 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.390701 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.391012 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.391333 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.391642 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.391959 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.392266 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.392586 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.392927 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.393239 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.393546 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.394929 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.395247 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.395573 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.395878 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.396187 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.396497 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.396835 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.397164 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.397491 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.397796 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.398119 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.398434 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.398753 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.399065 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.399374 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.399699 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.400007 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.400314 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.400620 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.400954 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.401263 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.401575 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.401883 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.402190 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.402500 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.402811 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.403135 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.403456 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.403762 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.404085 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.404407 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.404753 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.405087 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.405429 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.405761 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.406074 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.406383 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.406685 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:34:18.406924 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112113) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 22:34:18.542876 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO dbcounter [None req-b994dd08-ac6a-4fe6-bd50-dffe6510a3e4 None None] Registered counter for database nova_api Sep 06 22:34:18.563363 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG oslo_db.sqlalchemy.engines [None req-b994dd08-ac6a-4fe6-bd50-dffe6510a3e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112114) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 22:34:18.564860 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO dbcounter [None req-f4dcdb5b-6234-4284-9458-2fdbefb83660 None None] Registered counter for database nova_api Sep 06 22:34:18.570664 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG dbcounter [-] [112114] Writer thread running {{(pid=112114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 22:34:18.586544 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG oslo_db.sqlalchemy.engines [None req-f4dcdb5b-6234-4284-9458-2fdbefb83660 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112113) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 22:34:18.593072 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG dbcounter [-] [112113] Writer thread running {{(pid=112113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 22:34:18.627364 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.context [None req-b994dd08-ac6a-4fe6-bd50-dffe6510a3e4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2c8ddd81-1531-42c9-950d-068e09646658(cell1) {{(pid=112114) load_cells /opt/stack/nova/nova/context.py:464}} Sep 06 22:34:18.631934 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG oslo_concurrency.lockutils [None req-b994dd08-ac6a-4fe6-bd50-dffe6510a3e4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:34:18.632346 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG oslo_concurrency.lockutils [None req-b994dd08-ac6a-4fe6-bd50-dffe6510a3e4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:34:18.633915 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG oslo_concurrency.lockutils [None req-b994dd08-ac6a-4fe6-bd50-dffe6510a3e4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:34:18.634619 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG oslo_concurrency.lockutils [None req-b994dd08-ac6a-4fe6-bd50-dffe6510a3e4 None None] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:34:18.635053 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG oslo_concurrency.lockutils [None req-b994dd08-ac6a-4fe6-bd50-dffe6510a3e4 None None] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:34:18.637035 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG oslo_concurrency.lockutils [None req-b994dd08-ac6a-4fe6-bd50-dffe6510a3e4 None None] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:34:18.639290 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO dbcounter [None req-b994dd08-ac6a-4fe6-bd50-dffe6510a3e4 None None] Registered counter for database nova_cell0 Sep 06 22:34:18.643262 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO dbcounter [None req-b994dd08-ac6a-4fe6-bd50-dffe6510a3e4 None None] Registered counter for database nova_cell1 Sep 06 22:34:18.650464 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG oslo_db.sqlalchemy.engines [None req-b994dd08-ac6a-4fe6-bd50-dffe6510a3e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112114) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 22:34:18.652331 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.context [None req-f4dcdb5b-6234-4284-9458-2fdbefb83660 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2c8ddd81-1531-42c9-950d-068e09646658(cell1) {{(pid=112113) load_cells /opt/stack/nova/nova/context.py:464}} Sep 06 22:34:18.653023 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG oslo_db.sqlalchemy.engines [None req-b994dd08-ac6a-4fe6-bd50-dffe6510a3e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112114) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 22:34:18.656462 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG oslo_concurrency.lockutils [None req-f4dcdb5b-6234-4284-9458-2fdbefb83660 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:34:18.656966 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG oslo_concurrency.lockutils [None req-f4dcdb5b-6234-4284-9458-2fdbefb83660 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:34:18.658025 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG dbcounter [-] [112114] Writer thread running {{(pid=112114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 22:34:18.658560 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG oslo_concurrency.lockutils [None req-f4dcdb5b-6234-4284-9458-2fdbefb83660 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:34:18.659273 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG oslo_concurrency.lockutils [None req-f4dcdb5b-6234-4284-9458-2fdbefb83660 None None] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:34:18.660314 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG dbcounter [-] [112114] Writer thread running {{(pid=112114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 22:34:18.660856 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG oslo_concurrency.lockutils [None req-f4dcdb5b-6234-4284-9458-2fdbefb83660 None None] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:34:18.662850 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG oslo_concurrency.lockutils [None req-f4dcdb5b-6234-4284-9458-2fdbefb83660 None None] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112113) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:34:18.664878 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO dbcounter [None req-f4dcdb5b-6234-4284-9458-2fdbefb83660 None None] Registered counter for database nova_cell0 Sep 06 22:34:18.668985 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO dbcounter [None req-f4dcdb5b-6234-4284-9458-2fdbefb83660 None None] Registered counter for database nova_cell1 Sep 06 22:34:18.678670 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG oslo_db.sqlalchemy.engines [None req-f4dcdb5b-6234-4284-9458-2fdbefb83660 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112113) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 22:34:18.680346 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG oslo_db.sqlalchemy.engines [None req-f4dcdb5b-6234-4284-9458-2fdbefb83660 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112113) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 22:34:18.686196 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG dbcounter [-] [112113] Writer thread running {{(pid=112113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 22:34:18.688444 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG dbcounter [-] [112113] Writer thread running {{(pid=112113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 22:34:18.806288 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO dbcounter [None req-b994dd08-ac6a-4fe6-bd50-dffe6510a3e4 None None] Registered counter for database nova_cell0 Sep 06 22:34:18.814885 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG oslo_db.sqlalchemy.engines [None req-b994dd08-ac6a-4fe6-bd50-dffe6510a3e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112114) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 22:34:18.820059 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG dbcounter [-] [112114] Writer thread running {{(pid=112114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 22:34:18.838687 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO dbcounter [None req-f4dcdb5b-6234-4284-9458-2fdbefb83660 None None] Registered counter for database nova_cell0 Sep 06 22:34:18.847449 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG oslo_db.sqlalchemy.engines [None req-f4dcdb5b-6234-4284-9458-2fdbefb83660 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112113) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 22:34:18.852487 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG dbcounter [-] [112113] Writer thread running {{(pid=112113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 22:34:19.162207 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: WARNING keystonemiddleware.auth_token [None req-b994dd08-ac6a-4fe6-bd50-dffe6510a3e4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 22:34:19.169498 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: WARNING keystonemiddleware.auth_token [None req-b994dd08-ac6a-4fe6-bd50-dffe6510a3e4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 22:34:19.178815 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: WARNING keystonemiddleware.auth_token [None req-f4dcdb5b-6234-4284-9458-2fdbefb83660 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 22:34:19.186146 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: WARNING keystonemiddleware.auth_token [None req-f4dcdb5b-6234-4284-9458-2fdbefb83660 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 22:34:19.517322 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: WARNING keystonemiddleware.auth_token [None req-b994dd08-ac6a-4fe6-bd50-dffe6510a3e4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 22:34:19.523464 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: WARNING keystonemiddleware.auth_token [None req-b994dd08-ac6a-4fe6-bd50-dffe6510a3e4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 22:34:19.528844 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5633018e19c0 pid: 112114 (default app) Sep 06 22:34:19.530923 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-b994dd08-ac6a-4fe6-bd50-dffe6510a3e4 None None] Calling method '>' {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:34:19.532112 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.requestlog [None req-b994dd08-ac6a-4fe6-bd50-dffe6510a3e4 None None] 10.222.0.39 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001730 Sep 06 22:34:19.532520 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: [pid: 112114|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 788 bytes} [Tue Sep 6 22:34:19 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:34:19.542386 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: WARNING keystonemiddleware.auth_token [None req-f4dcdb5b-6234-4284-9458-2fdbefb83660 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 22:34:19.548353 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: WARNING keystonemiddleware.auth_token [None req-f4dcdb5b-6234-4284-9458-2fdbefb83660 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 22:34:19.554769 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5633018e19c0 pid: 112113 (default app) Sep 06 22:35:40.877061 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-b994dd08-ac6a-4fe6-bd50-dffe6510a3e4 None None] Calling method '>' {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:35:40.878055 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.requestlog [None req-b994dd08-ac6a-4fe6-bd50-dffe6510a3e4 None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 06 22:35:40.878448 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: [pid: 112114|app: 0|req: 2/2] 10.222.0.39 () {54 vars in 931 bytes} [Tue Sep 6 22:35:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:35:40.891338 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG dbcounter [-] [112113] Writing DB stats nova_api:SELECT=3 {{(pid=112113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:35:40.896943 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG dbcounter [-] [112113] Writing DB stats nova_cell1:SELECT=3 {{(pid=112113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:35:40.898815 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG dbcounter [-] [112113] Writing DB stats nova_cell0:SELECT=3 {{(pid=112113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:35:40.899663 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG dbcounter [-] [112113] Writing DB stats nova_cell0:SELECT=3 {{(pid=112113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:35:41.770808 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-a7c27245-33b3-4b51-a9b2-b685d0aceda5 admin admin] Calling method '>' {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:35:41.803101 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.requestlog [None req-a7c27245-33b3-4b51-a9b2-b685d0aceda5 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.917422 Sep 06 22:35:41.804730 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: [pid: 112113|app: 0|req: 1/3] 10.222.0.39 () {60 vars in 1292 bytes} [Tue Sep 6 22:35:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:35:44.446370 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-b994dd08-ac6a-4fe6-bd50-dffe6510a3e4 None None] Calling method '>' {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:35:44.447383 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.requestlog [None req-b994dd08-ac6a-4fe6-bd50-dffe6510a3e4 None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Sep 06 22:35:44.449395 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: [pid: 112114|app: 0|req: 3/4] 10.222.0.39 () {54 vars in 931 bytes} [Tue Sep 6 22:35:44 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:35:44.909211 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-b6c65f3f-dcaf-4b00-959c-f299e189a106 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1, "ram": 256, "swap": 0, "id": "c1", "os-flavor-access:is_public": true}} {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:35:44.960308 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.requestlog [None req-b6c65f3f-dcaf-4b00-959c-f299e189a106 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.506221 Sep 06 22:35:44.960963 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: [pid: 112113|app: 0|req: 2/5] 10.222.0.39 () {64 vars in 1283 bytes} [Tue Sep 6 22:35:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 22:35:44.975961 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG dbcounter [-] [112114] Writing DB stats nova_api:SELECT=3 {{(pid=112114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:35:44.977783 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG dbcounter [-] [112114] Writing DB stats nova_cell0:SELECT=3 {{(pid=112114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:35:44.979720 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG dbcounter [-] [112114] Writing DB stats nova_cell1:SELECT=3 {{(pid=112114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:35:44.980589 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG dbcounter [-] [112114] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:35:45.190835 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-0f521604-326c-4ca1-ac45-3f50f6bdb566 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:35:45.255818 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.requestlog [None req-0f521604-326c-4ca1-ac45-3f50f6bdb566 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.285155 Sep 06 22:35:45.256416 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: [pid: 112114|app: 0|req: 4/6] 10.222.0.39 () {64 vars in 1336 bytes} [Tue Sep 6 22:35:44 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:35:48.044591 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-b6c65f3f-dcaf-4b00-959c-f299e189a106 admin admin] Calling method '>' {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:35:48.046291 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.requestlog [None req-b6c65f3f-dcaf-4b00-959c-f299e189a106 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002064 Sep 06 22:35:48.046956 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: [pid: 112113|app: 0|req: 3/7] 10.222.0.39 () {54 vars in 931 bytes} [Tue Sep 6 22:35:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:35:48.712541 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-dba3c41e-bcc0-4b21-9ddb-2489111cf154 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "swap": 0, "id": "d1", "os-flavor-access:is_public": true, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "rxtx_factor": 1.0}} {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:35:48.753211 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.requestlog [None req-dba3c41e-bcc0-4b21-9ddb-2489111cf154 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.699884 Sep 06 22:35:48.753916 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: [pid: 112114|app: 0|req: 5/8] 10.222.0.39 () {64 vars in 1283 bytes} [Tue Sep 6 22:35:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 22:35:48.767233 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-45b5d8f7-21ad-441b-af0f-66f3d6bd3e49 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:35:48.810428 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.requestlog [None req-45b5d8f7-21ad-441b-af0f-66f3d6bd3e49 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047451 Sep 06 22:35:48.811519 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: [pid: 112113|app: 0|req: 4/9] 10.222.0.39 () {64 vars in 1336 bytes} [Tue Sep 6 22:35:48 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:35:51.420854 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-dba3c41e-bcc0-4b21-9ddb-2489111cf154 admin admin] Calling method '>' {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:35:51.421882 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.requestlog [None req-dba3c41e-bcc0-4b21-9ddb-2489111cf154 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 Sep 06 22:35:51.422537 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: [pid: 112114|app: 0|req: 6/10] 10.222.0.39 () {54 vars in 931 bytes} [Tue Sep 6 22:35:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:35:51.840374 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-c6666e7e-f520-4953-92ff-c51f15511214 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "ram": 1024, "disk": 10, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:35:51.859185 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.requestlog [None req-c6666e7e-f520-4953-92ff-c51f15511214 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.430145 Sep 06 22:35:51.859931 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: [pid: 112113|app: 0|req: 5/11] 10.222.0.39 () {64 vars in 1283 bytes} [Tue Sep 6 22:35:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 22:35:51.872337 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-08ffb3ee-e12f-41a2-b473-ee995cce82d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:35:51.898779 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.requestlog [None req-08ffb3ee-e12f-41a2-b473-ee995cce82d4 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030142 Sep 06 22:35:51.899575 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: [pid: 112114|app: 0|req: 7/12] 10.222.0.39 () {64 vars in 1336 bytes} [Tue Sep 6 22:35:51 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:35:54.586517 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-c6666e7e-f520-4953-92ff-c51f15511214 admin admin] Calling method '>' {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:35:54.587518 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.requestlog [None req-c6666e7e-f520-4953-92ff-c51f15511214 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Sep 06 22:35:54.588100 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: [pid: 112113|app: 0|req: 6/13] 10.222.0.39 () {54 vars in 931 bytes} [Tue Sep 6 22:35:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:35:55.033656 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-127062aa-550b-4263-a0d7-b8266300f0e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "ram": 2048, "id": "d3", "swap": 0, "rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true}} {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:35:55.055647 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.requestlog [None req-127062aa-550b-4263-a0d7-b8266300f0e2 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.461418 Sep 06 22:35:55.056541 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: [pid: 112114|app: 0|req: 8/14] 10.222.0.39 () {64 vars in 1283 bytes} [Tue Sep 6 22:35:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 22:35:55.068251 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-98d2bfa2-9f09-4e13-b5c3-b316aeca81a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:35:55.096040 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.requestlog [None req-98d2bfa2-9f09-4e13-b5c3-b316aeca81a0 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031329 Sep 06 22:35:55.097573 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: [pid: 112113|app: 0|req: 7/15] 10.222.0.39 () {64 vars in 1336 bytes} [Tue Sep 6 22:35:55 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:35:57.717199 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-127062aa-550b-4263-a0d7-b8266300f0e2 admin admin] Calling method '>' {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:35:57.718105 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.requestlog [None req-127062aa-550b-4263-a0d7-b8266300f0e2 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001565 Sep 06 22:35:57.718531 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: [pid: 112114|app: 0|req: 9/16] 10.222.0.39 () {54 vars in 931 bytes} [Tue Sep 6 22:35:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:35:58.194149 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-ccf1f77e-ac5c-43f8-9b95-e89d1099d6b2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 4096, "rxtx_factor": 1.0, "id": "d4", "vcpus": 4, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds4G"}} {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:35:58.215311 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.requestlog [None req-ccf1f77e-ac5c-43f8-9b95-e89d1099d6b2 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.490072 Sep 06 22:35:58.215889 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: [pid: 112113|app: 0|req: 8/17] 10.222.0.39 () {64 vars in 1283 bytes} [Tue Sep 6 22:35:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 22:35:58.228369 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-971ad684-3fb5-4ea7-b27c-696180a7ed6f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:35:58.251436 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.requestlog [None req-971ad684-3fb5-4ea7-b27c-696180a7ed6f admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027227 Sep 06 22:35:58.252242 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: [pid: 112114|app: 0|req: 10/18] 10.222.0.39 () {64 vars in 1336 bytes} [Tue Sep 6 22:35:58 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:36:01.755442 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-ccf1f77e-ac5c-43f8-9b95-e89d1099d6b2 admin admin] Calling method '>' {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:36:01.756491 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.requestlog [None req-ccf1f77e-ac5c-43f8-9b95-e89d1099d6b2 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Sep 06 22:36:01.758368 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: [pid: 112113|app: 0|req: 9/19] 10.222.0.39 () {54 vars in 931 bytes} [Tue Sep 6 22:36:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:36:02.185009 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-52c21b34-e735-4d8e-924c-1e25fd6749f4 admin admin] Calling method '>' {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:36:02.211026 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.requestlog [None req-52c21b34-e735-4d8e-924c-1e25fd6749f4 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.447449 Sep 06 22:36:02.211589 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: [pid: 112114|app: 0|req: 11/20] 10.222.0.39 () {60 vars in 1292 bytes} [Tue Sep 6 22:36:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:36:04.848076 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-ccf1f77e-ac5c-43f8-9b95-e89d1099d6b2 admin admin] Calling method '>' {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:36:04.849129 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.requestlog [None req-ccf1f77e-ac5c-43f8-9b95-e89d1099d6b2 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Sep 06 22:36:04.849543 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: [pid: 112113|app: 0|req: 10/21] 10.222.0.39 () {54 vars in 931 bytes} [Tue Sep 6 22:36:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:36:05.257720 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-d9a45c26-9a58-42d0-a147-814d002ba47c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "disk": 1, "name": "m1.tiny", "swap": 0, "ram": 512}} {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:36:05.279137 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.requestlog [None req-d9a45c26-9a58-42d0-a147-814d002ba47c admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.422973 Sep 06 22:36:05.279692 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: [pid: 112114|app: 0|req: 12/22] 10.222.0.39 () {64 vars in 1283 bytes} [Tue Sep 6 22:36:04 2022] POST /compute/v2.1/flavors => generated 402 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 22:36:05.292464 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-23541122-e5a8-44ae-97f1-e017ac3846a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:36:05.317611 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.requestlog [None req-23541122-e5a8-44ae-97f1-e017ac3846a9 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029582 Sep 06 22:36:05.318187 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: [pid: 112113|app: 0|req: 11/23] 10.222.0.39 () {64 vars in 1333 bytes} [Tue Sep 6 22:36:05 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:36:07.926662 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-d9a45c26-9a58-42d0-a147-814d002ba47c admin admin] Calling method '>' {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:36:07.928246 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.requestlog [None req-d9a45c26-9a58-42d0-a147-814d002ba47c admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002024 Sep 06 22:36:07.929850 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: [pid: 112114|app: 0|req: 13/24] 10.222.0.39 () {54 vars in 931 bytes} [Tue Sep 6 22:36:07 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:36:08.435716 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-94ee6779-615a-46df-8bb0-840567d673e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "id": "2", "disk": 20, "vcpus": 1, "ram": 2048, "swap": 0}} {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:36:08.455734 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.requestlog [None req-94ee6779-615a-46df-8bb0-840567d673e3 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.516964 Sep 06 22:36:08.456270 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: [pid: 112113|app: 0|req: 12/25] 10.222.0.39 () {64 vars in 1283 bytes} [Tue Sep 6 22:36:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 22:36:08.468908 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-3d29470b-e90d-4244-91cc-927dc861b251 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:36:08.494634 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.requestlog [None req-3d29470b-e90d-4244-91cc-927dc861b251 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029422 Sep 06 22:36:08.495630 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: [pid: 112114|app: 0|req: 14/26] 10.222.0.39 () {64 vars in 1333 bytes} [Tue Sep 6 22:36:08 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:36:11.169849 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-94ee6779-615a-46df-8bb0-840567d673e3 admin admin] Calling method '>' {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:36:11.170756 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.requestlog [None req-94ee6779-615a-46df-8bb0-840567d673e3 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 06 22:36:11.171153 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: [pid: 112113|app: 0|req: 13/27] 10.222.0.39 () {54 vars in 931 bytes} [Tue Sep 6 22:36:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:36:11.666237 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-584a812d-2ed3-47e5-a6a3-8157d8866c29 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "vcpus": 2, "name": "m1.medium", "id": "3", "swap": 0, "rxtx_factor": 1.0}} {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:36:11.690178 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.requestlog [None req-584a812d-2ed3-47e5-a6a3-8157d8866c29 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.512349 Sep 06 22:36:11.690647 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: [pid: 112114|app: 0|req: 15/28] 10.222.0.39 () {64 vars in 1283 bytes} [Tue Sep 6 22:36:11 2022] POST /compute/v2.1/flavors => generated 406 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 22:36:11.703284 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-da65a383-881a-4a1f-9844-b056c68df187 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:36:11.710176 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG dbcounter [-] [112113] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=112113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:36:11.739489 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.requestlog [None req-da65a383-881a-4a1f-9844-b056c68df187 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039758 Sep 06 22:36:11.740520 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: [pid: 112113|app: 0|req: 14/29] 10.222.0.39 () {64 vars in 1333 bytes} [Tue Sep 6 22:36:11 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:36:14.471769 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-584a812d-2ed3-47e5-a6a3-8157d8866c29 admin admin] Calling method '>' {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:36:14.472942 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.requestlog [None req-584a812d-2ed3-47e5-a6a3-8157d8866c29 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Sep 06 22:36:14.473509 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: [pid: 112114|app: 0|req: 16/30] 10.222.0.39 () {54 vars in 931 bytes} [Tue Sep 6 22:36:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:36:14.919012 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-371ddd64-b123-41bf-b036-63fc45bc00df admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "4", "name": "m1.large", "ram": 8192, "disk": 80}} {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:36:14.939819 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.requestlog [None req-371ddd64-b123-41bf-b036-63fc45bc00df admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.459294 Sep 06 22:36:14.940640 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: [pid: 112113|app: 0|req: 15/31] 10.222.0.39 () {64 vars in 1283 bytes} [Tue Sep 6 22:36:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 22:36:14.953005 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-a5d8fac5-6918-41c9-8cd2-e532238eaef3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:36:14.981514 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.requestlog [None req-a5d8fac5-6918-41c9-8cd2-e532238eaef3 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032066 Sep 06 22:36:14.985078 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: [pid: 112114|app: 0|req: 17/32] 10.222.0.39 () {64 vars in 1333 bytes} [Tue Sep 6 22:36:14 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:36:17.658834 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-371ddd64-b123-41bf-b036-63fc45bc00df admin admin] Calling method '>' {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:36:17.658834 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.requestlog [None req-371ddd64-b123-41bf-b036-63fc45bc00df admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Sep 06 22:36:17.661098 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: [pid: 112113|app: 0|req: 16/33] 10.222.0.39 () {54 vars in 931 bytes} [Tue Sep 6 22:36:17 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:36:18.234240 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-7ffe776a-4a99-466d-ad4e-ba0d66663144 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "ram": 16384, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "swap": 0, "rxtx_factor": 1.0, "vcpus": 8, "id": "5"}} {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:36:18.239914 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG dbcounter [-] [112114] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=112114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:36:18.259304 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.requestlog [None req-7ffe776a-4a99-466d-ad4e-ba0d66663144 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.594331 Sep 06 22:36:18.259855 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: [pid: 112114|app: 0|req: 18/34] 10.222.0.39 () {64 vars in 1283 bytes} [Tue Sep 6 22:36:17 2022] POST /compute/v2.1/flavors => generated 408 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 22:36:18.271923 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-d37e96fe-1af3-4fdf-89d2-9126af2d6c5d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:36:18.300361 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.requestlog [None req-d37e96fe-1af3-4fdf-89d2-9126af2d6c5d admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032031 Sep 06 22:36:18.301705 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: [pid: 112113|app: 0|req: 17/35] 10.222.0.39 () {64 vars in 1333 bytes} [Tue Sep 6 22:36:18 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:36:33.939002 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-7ffe776a-4a99-466d-ad4e-ba0d66663144 admin admin] Calling method '>' {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:36:33.940017 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.requestlog [None req-7ffe776a-4a99-466d-ad4e-ba0d66663144 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Sep 06 22:36:33.940412 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: [pid: 112114|app: 0|req: 19/36] 10.222.0.39 () {54 vars in 931 bytes} [Tue Sep 6 22:36:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:36:33.952145 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG dbcounter [-] [112113] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=112113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:36:34.326166 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-4ef2b6c8-c5d6-4406-ad6f-e5ed9a8a1967 admin admin] Calling method '>' {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:36:34.345863 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.requestlog [None req-4ef2b6c8-c5d6-4406-ad6f-e5ed9a8a1967 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.398179 Sep 06 22:36:34.346393 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: [pid: 112113|app: 0|req: 18/37] 10.222.0.39 () {60 vars in 1292 bytes} [Tue Sep 6 22:36:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:36:35.649549 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-7ffe776a-4a99-466d-ad4e-ba0d66663144 admin admin] Calling method '>' {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:36:35.650544 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.requestlog [None req-7ffe776a-4a99-466d-ad4e-ba0d66663144 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Sep 06 22:36:35.650931 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: [pid: 112114|app: 0|req: 20/38] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Sep 6 22:36:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:36:36.162635 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-faae2d4f-bffc-4390-a812-df5546d6d274 admin admin] Calling method '>' {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:36:36.168102 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.wsgi [None req-faae2d4f-bffc-4390-a812-df5546d6d274 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 06 22:36:36.171298 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-faae2d4f-bffc-4390-a812-df5546d6d274 admin admin] Request method failure captured: Sep 06 22:36:36.171298 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 06 22:36:36.171298 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: Accept: application/json Sep 06 22:36:36.171298 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: Accept-Encoding: gzip, deflate Sep 06 22:36:36.171298 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: Connection: keep-alive Sep 06 22:36:36.171298 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: Content-Length: 0 Sep 06 22:36:36.171298 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: Host: 10.222.0.39 Sep 06 22:36:36.171298 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: Openstack-Api-Version: compute 2.92 Sep 06 22:36:36.171298 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: Openstack-System-Scope: None Sep 06 22:36:36.171298 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: User-Agent: python-novaclient Sep 06 22:36:36.171298 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Auth-Token: gAAAAABjF8tzpyA8iYKxg0omo7vrulDRTMzDt966TW6aC8tpLCOIci67S4GXQAO1oF-qj5NGAghq8YJPi7Yk93gsVf5YoCqrkfVItumaslsCnO-DeQ6HpIlJQrKNscUljTgBzrUH47nrRm9RaSVZf4R6W4ZUpSJepEPAU8lgjvd4JKFmPxX8djU Sep 06 22:36:36.171298 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Domain-Id: None Sep 06 22:36:36.171298 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Domain-Name: None Sep 06 22:36:36.171298 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Identity-Status: Confirmed Sep 06 22:36:36.171298 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Is-Admin-Project: True Sep 06 22:36:36.171298 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 22:36:36.171298 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Project-Domain-Id: default Sep 06 22:36:36.171298 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Project-Domain-Name: Default Sep 06 22:36:36.171298 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Project-Id: 693d7b3554de4d2c9e0e732722fe61d1 Sep 06 22:36:36.171298 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Project-Name: admin Sep 06 22:36:36.171298 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Role: admin,reader,member Sep 06 22:36:36.171298 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Roles: admin,reader,member Sep 06 22:36:36.173006 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/693d7b3554de4d2c9e0e732722fe61d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_693d7b3554de4d2c9e0e732722fe61d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/693d7b3554de4d2c9e0e732722fe61d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/693d7b3554de4d2c9e0e732722fe61d1"}]}] Sep 06 22:36:36.173006 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Tenant: admin Sep 06 22:36:36.173006 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Tenant-Id: 693d7b3554de4d2c9e0e732722fe61d1 Sep 06 22:36:36.173006 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Tenant-Name: admin Sep 06 22:36:36.173006 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-User: admin Sep 06 22:36:36.173006 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-User-Domain-Id: default Sep 06 22:36:36.173006 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-User-Domain-Name: Default Sep 06 22:36:36.173006 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-User-Id: fee2283327204c6f8ee811e2c566e379 Sep 06 22:36:36.173006 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-User-Name: admin Sep 06 22:36:36.173006 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: method: > Sep 06 22:36:36.173006 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: exception: Flavor 42 could not be found. Sep 06 22:36:36.173006 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: action_args: {'id': '42'} Sep 06 22:36:36.173006 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:36:36.173006 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:36:36.174060 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 22:36:36.174060 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 22:36:36.174060 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 22:36:36.174060 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 22:36:36.174060 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 22:36:36.174060 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 22:36:36.174060 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 22:36:36.174060 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 22:36:36.174060 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 22:36:36.174060 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:36:36.174060 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 22:36:36.174060 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 22:36:36.174060 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 06 22:36:36.174060 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi Sep 06 22:36:36.174060 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:36:36.174060 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi Sep 06 22:36:36.174060 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:36:36.174060 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:36:36.174060 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:36:36.175414 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:36:36.175414 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:36:36.175414 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:36:36.175414 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:36:36.175414 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 22:36:36.175414 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:36:36.175414 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 06 22:36:36.175414 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi Sep 06 22:36:36.175414 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:36:36.175414 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi Sep 06 22:36:36.175414 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:36:36.175414 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:36:36.175414 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:36:36.175414 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:36:36.175414 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:36:36.175414 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 06 22:36:36.175414 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi Sep 06 22:36:36.175414 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-faae2d4f-bffc-4390-a812-df5546d6d274 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:36:36.176655 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.requestlog [None req-faae2d4f-bffc-4390-a812-df5546d6d274 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.384916 Sep 06 22:36:36.176655 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: [pid: 112113|app: 0|req: 19/39] 10.222.0.39 () {60 vars in 1190 bytes} [Tue Sep 6 22:36:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 386 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 22:36:36.184002 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-53324c3d-c169-4def-a411-d7260a06eb76 admin admin] Calling method '>' {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:36:36.206468 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.requestlog [None req-53324c3d-c169-4def-a411-d7260a06eb76 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026963 Sep 06 22:36:36.207014 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: [pid: 112114|app: 0|req: 21/40] 10.222.0.39 () {60 vars in 1210 bytes} [Tue Sep 6 22:36:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 22:36:36.217076 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-e5980f6c-3f4e-41ec-b8a8-36a29166eda4 admin admin] Calling method '>' {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:36:36.239622 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.requestlog [None req-e5980f6c-3f4e-41ec-b8a8-36a29166eda4 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026117 Sep 06 22:36:36.240767 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: [pid: 112113|app: 0|req: 20/41] 10.222.0.39 () {60 vars in 1210 bytes} [Tue Sep 6 22:36:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:36:36.249914 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-af78f830-fc6d-48d0-af46-02cf78f8ede9 admin admin] Calling method '>' {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:36:36.255509 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.wsgi [None req-af78f830-fc6d-48d0-af46-02cf78f8ede9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 06 22:36:36.258819 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-af78f830-fc6d-48d0-af46-02cf78f8ede9 admin admin] Request method failure captured: Sep 06 22:36:36.258819 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 06 22:36:36.258819 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: Accept: application/json Sep 06 22:36:36.258819 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: Accept-Encoding: gzip, deflate Sep 06 22:36:36.258819 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: Connection: keep-alive Sep 06 22:36:36.258819 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: Content-Length: 0 Sep 06 22:36:36.258819 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: Host: 10.222.0.39 Sep 06 22:36:36.258819 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: Openstack-Api-Version: compute 2.92 Sep 06 22:36:36.258819 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: Openstack-System-Scope: None Sep 06 22:36:36.258819 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: User-Agent: python-novaclient Sep 06 22:36:36.258819 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Auth-Token: gAAAAABjF8tzpyA8iYKxg0omo7vrulDRTMzDt966TW6aC8tpLCOIci67S4GXQAO1oF-qj5NGAghq8YJPi7Yk93gsVf5YoCqrkfVItumaslsCnO-DeQ6HpIlJQrKNscUljTgBzrUH47nrRm9RaSVZf4R6W4ZUpSJepEPAU8lgjvd4JKFmPxX8djU Sep 06 22:36:36.258819 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Domain-Id: None Sep 06 22:36:36.258819 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Domain-Name: None Sep 06 22:36:36.258819 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Identity-Status: Confirmed Sep 06 22:36:36.258819 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Is-Admin-Project: True Sep 06 22:36:36.258819 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 22:36:36.258819 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Project-Domain-Id: default Sep 06 22:36:36.258819 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Project-Domain-Name: Default Sep 06 22:36:36.258819 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Project-Id: 693d7b3554de4d2c9e0e732722fe61d1 Sep 06 22:36:36.258819 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Project-Name: admin Sep 06 22:36:36.258819 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Role: admin,reader,member Sep 06 22:36:36.258819 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Roles: admin,reader,member Sep 06 22:36:36.260320 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/693d7b3554de4d2c9e0e732722fe61d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_693d7b3554de4d2c9e0e732722fe61d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/693d7b3554de4d2c9e0e732722fe61d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/693d7b3554de4d2c9e0e732722fe61d1"}]}] Sep 06 22:36:36.260320 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Tenant: admin Sep 06 22:36:36.260320 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Tenant-Id: 693d7b3554de4d2c9e0e732722fe61d1 Sep 06 22:36:36.260320 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Tenant-Name: admin Sep 06 22:36:36.260320 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-User: admin Sep 06 22:36:36.260320 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-User-Domain-Id: default Sep 06 22:36:36.260320 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-User-Domain-Name: Default Sep 06 22:36:36.260320 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-User-Id: fee2283327204c6f8ee811e2c566e379 Sep 06 22:36:36.260320 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-User-Name: admin Sep 06 22:36:36.260320 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: method: > Sep 06 22:36:36.260320 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: exception: Flavor 42 could not be found. Sep 06 22:36:36.260320 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: action_args: {'id': '42'} Sep 06 22:36:36.260320 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:36:36.260320 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:36:36.261374 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 22:36:36.261374 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 22:36:36.261374 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 22:36:36.261374 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 22:36:36.261374 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 22:36:36.261374 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 22:36:36.261374 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 22:36:36.261374 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 22:36:36.261374 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 22:36:36.261374 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:36:36.261374 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 22:36:36.261374 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 22:36:36.261374 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 06 22:36:36.261374 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi Sep 06 22:36:36.261374 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:36:36.261374 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi Sep 06 22:36:36.261374 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:36:36.261374 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:36:36.261374 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:36:36.262718 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:36:36.262718 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:36:36.262718 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:36:36.262718 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:36:36.262718 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 22:36:36.262718 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:36:36.262718 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 06 22:36:36.262718 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi Sep 06 22:36:36.262718 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:36:36.262718 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi Sep 06 22:36:36.262718 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:36:36.262718 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:36:36.262718 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:36:36.262718 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:36:36.262718 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:36:36.262718 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 06 22:36:36.262718 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi Sep 06 22:36:36.262718 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-af78f830-fc6d-48d0-af46-02cf78f8ede9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:36:36.263932 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.requestlog [None req-af78f830-fc6d-48d0-af46-02cf78f8ede9 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013883 Sep 06 22:36:36.263932 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: [pid: 112114|app: 0|req: 22/42] 10.222.0.39 () {60 vars in 1190 bytes} [Tue Sep 6 22:36:36 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 06 22:36:37.473808 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-e5980f6c-3f4e-41ec-b8a8-36a29166eda4 admin admin] Calling method '>' {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:36:37.474841 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.requestlog [None req-e5980f6c-3f4e-41ec-b8a8-36a29166eda4 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Sep 06 22:36:37.475350 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: [pid: 112113|app: 0|req: 21/43] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Sep 6 22:36:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:36:37.994088 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-f23d1026-c92c-4e4b-8c05-93a37c4f7abd admin admin] Calling method '>' {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:36:37.999354 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.wsgi [None req-f23d1026-c92c-4e4b-8c05-93a37c4f7abd admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 06 22:36:38.000876 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-f23d1026-c92c-4e4b-8c05-93a37c4f7abd admin admin] Request method failure captured: Sep 06 22:36:38.000876 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 06 22:36:38.000876 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: Accept: application/json Sep 06 22:36:38.000876 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: Accept-Encoding: gzip, deflate Sep 06 22:36:38.000876 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: Connection: keep-alive Sep 06 22:36:38.000876 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: Content-Length: 0 Sep 06 22:36:38.000876 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: Host: 10.222.0.39 Sep 06 22:36:38.000876 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: Openstack-Api-Version: compute 2.92 Sep 06 22:36:38.000876 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: Openstack-System-Scope: None Sep 06 22:36:38.000876 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: User-Agent: python-novaclient Sep 06 22:36:38.000876 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Auth-Token: gAAAAABjF8t1FOppgbD_zxkM3E3DYx2KwtuMxEKLurvQHfe-H-JOSo1HrCW0ZdzLT_WHTzdFDnu4dI1mfTY4K3oLGj3CBVvmCFMuWfJXqjmyI6zIlJLSoUj9Rx2JpwT3C7HFhAEvV8l5DKUEiNktyudDPev9x6tt3YPiA3-k-KoL612wSlLJPZ4 Sep 06 22:36:38.000876 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Domain-Id: None Sep 06 22:36:38.000876 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Domain-Name: None Sep 06 22:36:38.000876 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Identity-Status: Confirmed Sep 06 22:36:38.000876 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Is-Admin-Project: True Sep 06 22:36:38.000876 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 22:36:38.000876 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Project-Domain-Id: default Sep 06 22:36:38.000876 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Project-Domain-Name: Default Sep 06 22:36:38.000876 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Project-Id: 693d7b3554de4d2c9e0e732722fe61d1 Sep 06 22:36:38.000876 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Project-Name: admin Sep 06 22:36:38.000876 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Role: admin,reader,member Sep 06 22:36:38.000876 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Roles: admin,reader,member Sep 06 22:36:38.002377 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/693d7b3554de4d2c9e0e732722fe61d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_693d7b3554de4d2c9e0e732722fe61d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/693d7b3554de4d2c9e0e732722fe61d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/693d7b3554de4d2c9e0e732722fe61d1"}]}] Sep 06 22:36:38.002377 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Tenant: admin Sep 06 22:36:38.002377 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Tenant-Id: 693d7b3554de4d2c9e0e732722fe61d1 Sep 06 22:36:38.002377 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Tenant-Name: admin Sep 06 22:36:38.002377 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-User: admin Sep 06 22:36:38.002377 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-User-Domain-Id: default Sep 06 22:36:38.002377 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-User-Domain-Name: Default Sep 06 22:36:38.002377 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-User-Id: fee2283327204c6f8ee811e2c566e379 Sep 06 22:36:38.002377 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-User-Name: admin Sep 06 22:36:38.002377 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: method: > Sep 06 22:36:38.002377 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: exception: Flavor 84 could not be found. Sep 06 22:36:38.002377 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: action_args: {'id': '84'} Sep 06 22:36:38.002377 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:36:38.002377 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:36:38.003299 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 22:36:38.003299 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 22:36:38.003299 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 22:36:38.003299 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 22:36:38.003299 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 22:36:38.003299 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 22:36:38.003299 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 22:36:38.003299 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 22:36:38.003299 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 22:36:38.003299 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:36:38.003299 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 22:36:38.003299 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 22:36:38.003299 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 06 22:36:38.003299 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi Sep 06 22:36:38.003299 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:36:38.003299 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi Sep 06 22:36:38.003299 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:36:38.003299 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:36:38.003299 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:36:38.004410 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:36:38.004410 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:36:38.004410 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:36:38.004410 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:36:38.004410 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 22:36:38.004410 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:36:38.004410 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 06 22:36:38.004410 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi Sep 06 22:36:38.004410 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:36:38.004410 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi Sep 06 22:36:38.004410 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:36:38.004410 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:36:38.004410 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:36:38.004410 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:36:38.004410 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:36:38.004410 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 06 22:36:38.004410 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi Sep 06 22:36:38.004410 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-f23d1026-c92c-4e4b-8c05-93a37c4f7abd admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:36:38.006372 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.requestlog [None req-f23d1026-c92c-4e4b-8c05-93a37c4f7abd admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.388754 Sep 06 22:36:38.006372 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: [pid: 112114|app: 0|req: 23/44] 10.222.0.39 () {60 vars in 1190 bytes} [Tue Sep 6 22:36:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 22:36:38.012437 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-f14dcac3-8182-4438-8db6-173df8e3c700 admin admin] Calling method '>' {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:36:38.028251 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.requestlog [None req-f14dcac3-8182-4438-8db6-173df8e3c700 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019434 Sep 06 22:36:38.028783 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: [pid: 112113|app: 0|req: 22/45] 10.222.0.39 () {60 vars in 1210 bytes} [Tue Sep 6 22:36:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:36:38.037918 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-f53d75c6-80d4-4aa5-982f-1c9557f4a4fc admin admin] Calling method '>' {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:36:38.052909 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.requestlog [None req-f53d75c6-80d4-4aa5-982f-1c9557f4a4fc admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018328 Sep 06 22:36:38.053431 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: [pid: 112114|app: 0|req: 24/46] 10.222.0.39 () {60 vars in 1210 bytes} [Tue Sep 6 22:36:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:36:38.062281 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-2e7ec98a-55ba-4178-a35a-31900e843bd1 admin admin] Calling method '>' {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:36:38.067467 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.wsgi [None req-2e7ec98a-55ba-4178-a35a-31900e843bd1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 06 22:36:38.069487 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-2e7ec98a-55ba-4178-a35a-31900e843bd1 admin admin] Request method failure captured: Sep 06 22:36:38.069487 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 06 22:36:38.069487 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: Accept: application/json Sep 06 22:36:38.069487 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: Accept-Encoding: gzip, deflate Sep 06 22:36:38.069487 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: Connection: keep-alive Sep 06 22:36:38.069487 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: Content-Length: 0 Sep 06 22:36:38.069487 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: Host: 10.222.0.39 Sep 06 22:36:38.069487 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: Openstack-Api-Version: compute 2.92 Sep 06 22:36:38.069487 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: Openstack-System-Scope: None Sep 06 22:36:38.069487 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: User-Agent: python-novaclient Sep 06 22:36:38.069487 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Auth-Token: gAAAAABjF8t1FOppgbD_zxkM3E3DYx2KwtuMxEKLurvQHfe-H-JOSo1HrCW0ZdzLT_WHTzdFDnu4dI1mfTY4K3oLGj3CBVvmCFMuWfJXqjmyI6zIlJLSoUj9Rx2JpwT3C7HFhAEvV8l5DKUEiNktyudDPev9x6tt3YPiA3-k-KoL612wSlLJPZ4 Sep 06 22:36:38.069487 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Domain-Id: None Sep 06 22:36:38.069487 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Domain-Name: None Sep 06 22:36:38.069487 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Identity-Status: Confirmed Sep 06 22:36:38.069487 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Is-Admin-Project: True Sep 06 22:36:38.069487 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 22:36:38.069487 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Project-Domain-Id: default Sep 06 22:36:38.069487 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Project-Domain-Name: Default Sep 06 22:36:38.069487 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Project-Id: 693d7b3554de4d2c9e0e732722fe61d1 Sep 06 22:36:38.069487 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Project-Name: admin Sep 06 22:36:38.069487 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Role: admin,reader,member Sep 06 22:36:38.069487 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Roles: admin,reader,member Sep 06 22:36:38.071052 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/693d7b3554de4d2c9e0e732722fe61d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_693d7b3554de4d2c9e0e732722fe61d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/693d7b3554de4d2c9e0e732722fe61d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/693d7b3554de4d2c9e0e732722fe61d1"}]}] Sep 06 22:36:38.071052 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Tenant: admin Sep 06 22:36:38.071052 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Tenant-Id: 693d7b3554de4d2c9e0e732722fe61d1 Sep 06 22:36:38.071052 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Tenant-Name: admin Sep 06 22:36:38.071052 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-User: admin Sep 06 22:36:38.071052 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-User-Domain-Id: default Sep 06 22:36:38.071052 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-User-Domain-Name: Default Sep 06 22:36:38.071052 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-User-Id: fee2283327204c6f8ee811e2c566e379 Sep 06 22:36:38.071052 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-User-Name: admin Sep 06 22:36:38.071052 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: method: > Sep 06 22:36:38.071052 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: exception: Flavor 84 could not be found. Sep 06 22:36:38.071052 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: action_args: {'id': '84'} Sep 06 22:36:38.071052 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:36:38.071052 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:36:38.071970 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 22:36:38.071970 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 22:36:38.071970 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 22:36:38.071970 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 22:36:38.071970 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 22:36:38.071970 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 22:36:38.071970 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 22:36:38.071970 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 22:36:38.071970 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 22:36:38.071970 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:36:38.071970 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 22:36:38.071970 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 22:36:38.071970 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 06 22:36:38.071970 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi Sep 06 22:36:38.071970 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:36:38.071970 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi Sep 06 22:36:38.071970 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:36:38.071970 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:36:38.071970 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:36:38.073176 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:36:38.073176 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:36:38.073176 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:36:38.073176 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:36:38.073176 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 22:36:38.073176 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:36:38.073176 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 06 22:36:38.073176 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi Sep 06 22:36:38.073176 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:36:38.073176 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi Sep 06 22:36:38.073176 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:36:38.073176 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:36:38.073176 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:36:38.073176 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:36:38.073176 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:36:38.073176 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 06 22:36:38.073176 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi Sep 06 22:36:38.073176 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-2e7ec98a-55ba-4178-a35a-31900e843bd1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:36:38.074292 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.requestlog [None req-2e7ec98a-55ba-4178-a35a-31900e843bd1 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011994 Sep 06 22:36:38.074292 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: [pid: 112113|app: 0|req: 23/47] 10.222.0.39 () {60 vars in 1190 bytes} [Tue Sep 6 22:36:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 06 22:36:39.331761 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-f53d75c6-80d4-4aa5-982f-1c9557f4a4fc admin admin] Calling method '>' {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:36:39.332768 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.requestlog [None req-f53d75c6-80d4-4aa5-982f-1c9557f4a4fc admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Sep 06 22:36:39.333161 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: [pid: 112114|app: 0|req: 25/48] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Sep 6 22:36:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:36:39.850006 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-da58c095-621d-402e-afd6-d5bb29ed9c1c admin admin] Calling method '>' {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:36:39.855732 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.wsgi [None req-da58c095-621d-402e-afd6-d5bb29ed9c1c admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 06 22:36:39.857262 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-da58c095-621d-402e-afd6-d5bb29ed9c1c admin admin] Request method failure captured: Sep 06 22:36:39.857262 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 06 22:36:39.857262 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: Accept: application/json Sep 06 22:36:39.857262 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: Accept-Encoding: gzip, deflate Sep 06 22:36:39.857262 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: Connection: keep-alive Sep 06 22:36:39.857262 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: Content-Length: 0 Sep 06 22:36:39.857262 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: Host: 10.222.0.39 Sep 06 22:36:39.857262 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: Openstack-Api-Version: compute 2.92 Sep 06 22:36:39.857262 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: Openstack-System-Scope: None Sep 06 22:36:39.857262 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: User-Agent: python-novaclient Sep 06 22:36:39.857262 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Auth-Token: gAAAAABjF8t3i6AZmYIo4NRSBSrvCKJ7EWGs3UEsGXcmYw_CyMKHcISZnoPjvfC6KuEBmuOm6CR37Sds66jJvPqESNTDoK_hOxdfiQ5oPSiSe0C4X08-DVlccHa1vY00QbgtepIxfKBlhYDuSiXvKTTtwMiH94tME1cmGoZa4AGcYQt4F_HNr3A Sep 06 22:36:39.857262 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Domain-Id: None Sep 06 22:36:39.857262 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Domain-Name: None Sep 06 22:36:39.857262 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Identity-Status: Confirmed Sep 06 22:36:39.857262 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Is-Admin-Project: True Sep 06 22:36:39.857262 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 22:36:39.857262 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Project-Domain-Id: default Sep 06 22:36:39.857262 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Project-Domain-Name: Default Sep 06 22:36:39.857262 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Project-Id: 693d7b3554de4d2c9e0e732722fe61d1 Sep 06 22:36:39.857262 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Project-Name: admin Sep 06 22:36:39.857262 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Role: admin,reader,member Sep 06 22:36:39.857262 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Roles: admin,reader,member Sep 06 22:36:39.858725 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/693d7b3554de4d2c9e0e732722fe61d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_693d7b3554de4d2c9e0e732722fe61d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/693d7b3554de4d2c9e0e732722fe61d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/693d7b3554de4d2c9e0e732722fe61d1"}]}] Sep 06 22:36:39.858725 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Tenant: admin Sep 06 22:36:39.858725 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Tenant-Id: 693d7b3554de4d2c9e0e732722fe61d1 Sep 06 22:36:39.858725 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-Tenant-Name: admin Sep 06 22:36:39.858725 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-User: admin Sep 06 22:36:39.858725 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-User-Domain-Id: default Sep 06 22:36:39.858725 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-User-Domain-Name: Default Sep 06 22:36:39.858725 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-User-Id: fee2283327204c6f8ee811e2c566e379 Sep 06 22:36:39.858725 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: X-User-Name: admin Sep 06 22:36:39.858725 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: method: > Sep 06 22:36:39.858725 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: exception: Flavor 451 could not be found. Sep 06 22:36:39.858725 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: action_args: {'id': '451'} Sep 06 22:36:39.858725 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:36:39.858725 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:36:39.859565 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 22:36:39.859565 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 22:36:39.859565 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 22:36:39.859565 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 22:36:39.859565 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 22:36:39.859565 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 22:36:39.859565 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 22:36:39.859565 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 22:36:39.859565 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 22:36:39.859565 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:36:39.859565 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 22:36:39.859565 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 22:36:39.859565 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 06 22:36:39.859565 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi Sep 06 22:36:39.859565 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:36:39.859565 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi Sep 06 22:36:39.859565 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:36:39.859565 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:36:39.859565 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:36:39.860795 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:36:39.860795 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:36:39.860795 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:36:39.860795 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:36:39.860795 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 22:36:39.860795 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:36:39.860795 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 06 22:36:39.860795 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi Sep 06 22:36:39.860795 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:36:39.860795 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi Sep 06 22:36:39.860795 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:36:39.860795 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:36:39.860795 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:36:39.860795 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:36:39.860795 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:36:39.860795 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 06 22:36:39.860795 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: ERROR nova.api.openstack.wsgi Sep 06 22:36:39.860795 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-da58c095-621d-402e-afd6-d5bb29ed9c1c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112113) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:36:39.862272 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.requestlog [None req-da58c095-621d-402e-afd6-d5bb29ed9c1c admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.387884 Sep 06 22:36:39.862272 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: [pid: 112113|app: 0|req: 24/49] 10.222.0.39 () {60 vars in 1193 bytes} [Tue Sep 6 22:36:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 22:36:39.869047 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-0e395e29-2efe-47b7-9e4b-82356611656b admin admin] Calling method '>' {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:36:39.883889 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.requestlog [None req-0e395e29-2efe-47b7-9e4b-82356611656b admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018942 Sep 06 22:36:39.884397 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: [pid: 112114|app: 0|req: 26/50] 10.222.0.39 () {60 vars in 1210 bytes} [Tue Sep 6 22:36:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:36:39.893942 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-de46798e-094b-4327-b439-52a45ed52864 admin admin] Calling method '>' {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:36:39.909437 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.requestlog [None req-de46798e-094b-4327-b439-52a45ed52864 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019245 Sep 06 22:36:39.909984 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: [pid: 112113|app: 0|req: 25/51] 10.222.0.39 () {60 vars in 1210 bytes} [Tue Sep 6 22:36:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:36:39.919538 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-e22be826-9bf8-4e5a-abb5-75cb72c071b1 admin admin] Calling method '>' {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:36:39.924777 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.wsgi [None req-e22be826-9bf8-4e5a-abb5-75cb72c071b1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 06 22:36:39.926271 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-e22be826-9bf8-4e5a-abb5-75cb72c071b1 admin admin] Request method failure captured: Sep 06 22:36:39.926271 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 06 22:36:39.926271 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: Accept: application/json Sep 06 22:36:39.926271 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: Accept-Encoding: gzip, deflate Sep 06 22:36:39.926271 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: Connection: keep-alive Sep 06 22:36:39.926271 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: Content-Length: 0 Sep 06 22:36:39.926271 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: Host: 10.222.0.39 Sep 06 22:36:39.926271 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: Openstack-Api-Version: compute 2.92 Sep 06 22:36:39.926271 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: Openstack-System-Scope: None Sep 06 22:36:39.926271 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: User-Agent: python-novaclient Sep 06 22:36:39.926271 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Auth-Token: gAAAAABjF8t3i6AZmYIo4NRSBSrvCKJ7EWGs3UEsGXcmYw_CyMKHcISZnoPjvfC6KuEBmuOm6CR37Sds66jJvPqESNTDoK_hOxdfiQ5oPSiSe0C4X08-DVlccHa1vY00QbgtepIxfKBlhYDuSiXvKTTtwMiH94tME1cmGoZa4AGcYQt4F_HNr3A Sep 06 22:36:39.926271 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Domain-Id: None Sep 06 22:36:39.926271 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Domain-Name: None Sep 06 22:36:39.926271 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Identity-Status: Confirmed Sep 06 22:36:39.926271 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Is-Admin-Project: True Sep 06 22:36:39.926271 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 22:36:39.926271 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Project-Domain-Id: default Sep 06 22:36:39.926271 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Project-Domain-Name: Default Sep 06 22:36:39.926271 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Project-Id: 693d7b3554de4d2c9e0e732722fe61d1 Sep 06 22:36:39.926271 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Project-Name: admin Sep 06 22:36:39.926271 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Role: admin,reader,member Sep 06 22:36:39.926271 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Roles: admin,reader,member Sep 06 22:36:39.927782 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/693d7b3554de4d2c9e0e732722fe61d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_693d7b3554de4d2c9e0e732722fe61d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/693d7b3554de4d2c9e0e732722fe61d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/693d7b3554de4d2c9e0e732722fe61d1"}]}] Sep 06 22:36:39.927782 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Tenant: admin Sep 06 22:36:39.927782 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Tenant-Id: 693d7b3554de4d2c9e0e732722fe61d1 Sep 06 22:36:39.927782 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-Tenant-Name: admin Sep 06 22:36:39.927782 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-User: admin Sep 06 22:36:39.927782 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-User-Domain-Id: default Sep 06 22:36:39.927782 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-User-Domain-Name: Default Sep 06 22:36:39.927782 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-User-Id: fee2283327204c6f8ee811e2c566e379 Sep 06 22:36:39.927782 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: X-User-Name: admin Sep 06 22:36:39.927782 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: method: > Sep 06 22:36:39.927782 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: exception: Flavor 451 could not be found. Sep 06 22:36:39.927782 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: action_args: {'id': '451'} Sep 06 22:36:39.927782 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:36:39.927782 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:36:39.928812 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 22:36:39.928812 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 22:36:39.928812 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 22:36:39.928812 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 22:36:39.928812 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 22:36:39.928812 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 22:36:39.928812 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 22:36:39.928812 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 22:36:39.928812 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 22:36:39.928812 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:36:39.928812 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 22:36:39.928812 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 22:36:39.928812 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 06 22:36:39.928812 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi Sep 06 22:36:39.928812 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:36:39.928812 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi Sep 06 22:36:39.928812 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:36:39.928812 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:36:39.928812 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:36:39.930096 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:36:39.930096 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:36:39.930096 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:36:39.930096 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:36:39.930096 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 22:36:39.930096 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:36:39.930096 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 06 22:36:39.930096 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi Sep 06 22:36:39.930096 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:36:39.930096 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi Sep 06 22:36:39.930096 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:36:39.930096 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:36:39.930096 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:36:39.930096 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:36:39.930096 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:36:39.930096 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 06 22:36:39.930096 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: ERROR nova.api.openstack.wsgi Sep 06 22:36:39.930096 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-e22be826-9bf8-4e5a-abb5-75cb72c071b1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112114) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:36:39.931143 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.requestlog [None req-e22be826-9bf8-4e5a-abb5-75cb72c071b1 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011522 Sep 06 22:36:39.931143 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: [pid: 112114|app: 0|req: 27/52] 10.222.0.39 () {60 vars in 1193 bytes} [Tue Sep 6 22:36:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 22:36:41.135760 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-de46798e-094b-4327-b439-52a45ed52864 admin admin] Calling method '>' {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:36:41.136767 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.requestlog [None req-de46798e-094b-4327-b439-52a45ed52864 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Sep 06 22:36:41.137169 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: [pid: 112113|app: 0|req: 26/53] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Sep 6 22:36:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:36:41.653517 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-786b3495-05f8-48f9-b986-6ff3d27d805b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:36:41.672932 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.requestlog [None req-786b3495-05f8-48f9-b986-6ff3d27d805b admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.400085 Sep 06 22:36:41.673478 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: [pid: 112114|app: 0|req: 28/54] 10.222.0.39 () {64 vars in 1235 bytes} [Tue Sep 6 22:36:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 22:36:42.902614 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-de46798e-094b-4327-b439-52a45ed52864 admin admin] Calling method '>' {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:36:42.903633 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.requestlog [None req-de46798e-094b-4327-b439-52a45ed52864 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Sep 06 22:36:42.904037 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: [pid: 112113|app: 0|req: 27/55] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Sep 6 22:36:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:36:43.445869 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-8631a1f6-8415-427d-bc34-1dbf6d1401dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:36:43.464266 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.requestlog [None req-8631a1f6-8415-427d-bc34-1dbf6d1401dd admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.417517 Sep 06 22:36:43.464748 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: [pid: 112114|app: 0|req: 29/56] 10.222.0.39 () {64 vars in 1235 bytes} [Tue Sep 6 22:36:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 22:36:44.691797 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-de46798e-094b-4327-b439-52a45ed52864 admin admin] Calling method '>' {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:36:44.693401 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.requestlog [None req-de46798e-094b-4327-b439-52a45ed52864 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Sep 06 22:36:44.694612 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: [pid: 112113|app: 0|req: 28/57] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Sep 6 22:36:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:36:45.230572 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-fe1a48e4-409d-4d76-afec-cf61579f8454 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:36:45.250119 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.requestlog [None req-fe1a48e4-409d-4d76-afec-cf61579f8454 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.407746 Sep 06 22:36:45.250651 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: [pid: 112114|app: 0|req: 30/58] 10.222.0.39 () {64 vars in 1235 bytes} [Tue Sep 6 22:36:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 22:36:46.484026 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-de46798e-094b-4327-b439-52a45ed52864 admin admin] Calling method '>' {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:36:46.485079 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.requestlog [None req-de46798e-094b-4327-b439-52a45ed52864 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Sep 06 22:36:46.485500 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: [pid: 112113|app: 0|req: 29/59] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Sep 6 22:36:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:36:47.030114 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-74570e3d-62dc-42f9-9c44-a4eccc0f6e59 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:36:47.048530 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.requestlog [None req-74570e3d-62dc-42f9-9c44-a4eccc0f6e59 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.422830 Sep 06 22:36:47.049095 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: [pid: 112114|app: 0|req: 31/60] 10.222.0.39 () {64 vars in 1235 bytes} [Tue Sep 6 22:36:46 2022] POST /compute/v2.1/flavors => generated 409 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 22:36:48.260235 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-de46798e-094b-4327-b439-52a45ed52864 admin admin] Calling method '>' {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:36:48.261259 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.requestlog [None req-de46798e-094b-4327-b439-52a45ed52864 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Sep 06 22:36:48.261654 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: [pid: 112113|app: 0|req: 30/61] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Sep 6 22:36:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:36:48.795316 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-c028b28d-a1c4-4210-8f8e-d852be06860c admin admin] Calling method '>' {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:36:48.820557 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.requestlog [None req-c028b28d-a1c4-4210-8f8e-d852be06860c admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.422095 Sep 06 22:36:48.821111 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: [pid: 112114|app: 0|req: 32/62] 10.222.0.39 () {60 vars in 1202 bytes} [Tue Sep 6 22:36:48 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:37:45.651290 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-de46798e-094b-4327-b439-52a45ed52864 admin admin] Calling method '>' {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:37:45.652285 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.requestlog [None req-de46798e-094b-4327-b439-52a45ed52864 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Sep 06 22:37:45.652683 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: [pid: 112113|app: 0|req: 31/63] 10.222.0.39 () {54 vars in 931 bytes} [Tue Sep 6 22:37:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:37:45.663782 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG dbcounter [-] [112114] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=112114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:46.061625 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-42d067c8-6842-453f-ae68-b5c9fb656c33 admin admin] Calling method '>' {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:37:46.083249 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.requestlog [None req-42d067c8-6842-453f-ae68-b5c9fb656c33 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.424459 Sep 06 22:37:46.083758 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: [pid: 112114|app: 0|req: 33/64] 10.222.0.39 () {60 vars in 1292 bytes} [Tue Sep 6 22:37:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:37:46.104732 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG dbcounter [-] [112113] Writing DB stats nova_api:SELECT=14 {{(pid=112113) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:37:46.108472 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-4ad092d6-b662-434c-86dc-6faddbdb5841 admin admin] Calling method '>' {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:37:46.116686 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.requestlog [None req-4ad092d6-b662-434c-86dc-6faddbdb5841 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013339 Sep 06 22:37:46.117266 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: [pid: 112113|app: 0|req: 32/65] 10.222.0.39 () {60 vars in 1283 bytes} [Tue Sep 6 22:37:46 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:37:46.129969 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-f6398352-3c62-49fe-9b4e-31d9b635636b admin admin] Calling method '>' {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:37:46.138800 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.requestlog [None req-f6398352-3c62-49fe-9b4e-31d9b635636b admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013343 Sep 06 22:37:46.139327 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: [pid: 112114|app: 0|req: 34/66] 10.222.0.39 () {60 vars in 1286 bytes} [Tue Sep 6 22:37:46 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:37:46.151668 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-b9aee120-8e05-4769-879e-fa6865bf94b2 admin admin] Calling method '>' {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:37:46.162366 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.requestlog [None req-b9aee120-8e05-4769-879e-fa6865bf94b2 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014561 Sep 06 22:37:46.162912 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: [pid: 112113|app: 0|req: 33/67] 10.222.0.39 () {60 vars in 1286 bytes} [Tue Sep 6 22:37:46 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:37:46.175375 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-37ae0237-acbf-4ebb-949c-5d3165045202 admin admin] Calling method '>' {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:37:46.184280 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.requestlog [None req-37ae0237-acbf-4ebb-949c-5d3165045202 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013016 Sep 06 22:37:46.184843 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: [pid: 112114|app: 0|req: 35/68] 10.222.0.39 () {60 vars in 1283 bytes} [Tue Sep 6 22:37:46 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:40:42.168219 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-b9aee120-8e05-4769-879e-fa6865bf94b2 admin admin] Calling method '>' {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:40:42.169249 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.requestlog [None req-b9aee120-8e05-4769-879e-fa6865bf94b2 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Sep 06 22:40:42.169645 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: [pid: 112113|app: 0|req: 34/69] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Sep 6 22:40:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:40:42.311770 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG dbcounter [-] [112114] Writing DB stats nova_api:SELECT=6 {{(pid=112114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:42.475707 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-acd817d1-9c24-4c84-a31e-7c5313bed38c admin admin] Calling method '>' {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:40:42.479113 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG oslo_concurrency.lockutils [None req-acd817d1-9c24-4c84-a31e-7c5313bed38c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:40:42.479583 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG oslo_concurrency.lockutils [None req-acd817d1-9c24-4c84-a31e-7c5313bed38c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:40:42.480009 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG oslo_concurrency.lockutils [None req-acd817d1-9c24-4c84-a31e-7c5313bed38c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:40:42.480722 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG oslo_concurrency.lockutils [None req-acd817d1-9c24-4c84-a31e-7c5313bed38c admin admin] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:40:42.481191 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG oslo_concurrency.lockutils [None req-acd817d1-9c24-4c84-a31e-7c5313bed38c admin admin] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:40:42.481606 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG oslo_concurrency.lockutils [None req-acd817d1-9c24-4c84-a31e-7c5313bed38c admin admin] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:40:42.515156 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.requestlog [None req-acd817d1-9c24-4c84-a31e-7c5313bed38c admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.204836 Sep 06 22:40:42.515708 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: [pid: 112114|app: 0|req: 36/70] 10.222.0.39 () {60 vars in 1193 bytes} [Tue Sep 6 22:40:42 2022] GET /compute/v2.1/os-services => generated 794 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 22:40:43.609039 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-b9aee120-8e05-4769-879e-fa6865bf94b2 admin admin] Calling method '>' {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:40:43.610077 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.requestlog [None req-b9aee120-8e05-4769-879e-fa6865bf94b2 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Sep 06 22:40:43.610957 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: [pid: 112113|app: 0|req: 35/71] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Sep 6 22:40:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:40:43.814213 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-5f44ba18-39b3-4452-ac41-09745be4c648 admin admin] Calling method '>' {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:40:43.817654 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG oslo_concurrency.lockutils [None req-5f44ba18-39b3-4452-ac41-09745be4c648 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:40:43.818125 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG oslo_concurrency.lockutils [None req-5f44ba18-39b3-4452-ac41-09745be4c648 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:40:43.818553 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG oslo_concurrency.lockutils [None req-5f44ba18-39b3-4452-ac41-09745be4c648 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:40:43.819261 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG oslo_concurrency.lockutils [None req-5f44ba18-39b3-4452-ac41-09745be4c648 admin admin] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:40:43.819703 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG oslo_concurrency.lockutils [None req-5f44ba18-39b3-4452-ac41-09745be4c648 admin admin] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:40:43.820118 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG oslo_concurrency.lockutils [None req-5f44ba18-39b3-4452-ac41-09745be4c648 admin admin] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:40:43.843869 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.requestlog [None req-5f44ba18-39b3-4452-ac41-09745be4c648 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.081647 Sep 06 22:40:43.844496 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: [pid: 112114|app: 0|req: 37/72] 10.222.0.39 () {60 vars in 1193 bytes} [Tue Sep 6 22:40:43 2022] GET /compute/v2.1/os-services => generated 794 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 22:40:55.350138 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-b9aee120-8e05-4769-879e-fa6865bf94b2 admin admin] Calling method '>' {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:40:55.351183 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.requestlog [None req-b9aee120-8e05-4769-879e-fa6865bf94b2 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001396 Sep 06 22:40:55.351557 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: [pid: 112113|app: 0|req: 36/73] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Sep 6 22:40:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:40:55.493930 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG dbcounter [-] [112114] Writing DB stats nova_cell0:SELECT=4 {{(pid=112114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:55.494647 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG dbcounter [-] [112114] Writing DB stats nova_cell1:SELECT=4 {{(pid=112114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:55.495312 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG dbcounter [-] [112114] Writing DB stats nova_api:SELECT=8 {{(pid=112114) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:40:55.542925 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-33075c39-cd37-47c6-9828-5144ee13abad admin admin] Calling method '>' {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:40:55.546342 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG oslo_concurrency.lockutils [None req-33075c39-cd37-47c6-9828-5144ee13abad admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:40:55.546807 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG oslo_concurrency.lockutils [None req-33075c39-cd37-47c6-9828-5144ee13abad admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:40:55.547224 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG oslo_concurrency.lockutils [None req-33075c39-cd37-47c6-9828-5144ee13abad admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:40:55.547995 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG oslo_concurrency.lockutils [None req-33075c39-cd37-47c6-9828-5144ee13abad admin admin] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:40:55.548458 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG oslo_concurrency.lockutils [None req-33075c39-cd37-47c6-9828-5144ee13abad admin admin] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:40:55.548893 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG oslo_concurrency.lockutils [None req-33075c39-cd37-47c6-9828-5144ee13abad admin admin] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:40:55.574738 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.requestlog [None req-33075c39-cd37-47c6-9828-5144ee13abad admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.085194 Sep 06 22:40:55.575295 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: [pid: 112114|app: 0|req: 38/74] 10.222.0.39 () {60 vars in 1193 bytes} [Tue Sep 6 22:40:55 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:40:56.682513 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: DEBUG nova.api.openstack.wsgi [None req-b9aee120-8e05-4769-879e-fa6865bf94b2 admin admin] Calling method '>' {{(pid=112113) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:40:56.683528 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: INFO nova.api.openstack.requestlog [None req-b9aee120-8e05-4769-879e-fa6865bf94b2 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Sep 06 22:40:56.683919 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: [pid: 112113|app: 0|req: 37/75] 10.222.0.39 () {56 vars in 1074 bytes} [Tue Sep 6 22:40:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:40:56.874751 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG nova.api.openstack.wsgi [None req-7841b808-daec-4533-8145-c781c97565ed admin admin] Calling method '>' {{(pid=112114) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:40:56.879182 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG oslo_concurrency.lockutils [None req-7841b808-daec-4533-8145-c781c97565ed admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:40:56.879654 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG oslo_concurrency.lockutils [None req-7841b808-daec-4533-8145-c781c97565ed admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:40:56.880079 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG oslo_concurrency.lockutils [None req-7841b808-daec-4533-8145-c781c97565ed admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:40:56.880801 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG oslo_concurrency.lockutils [None req-7841b808-daec-4533-8145-c781c97565ed admin admin] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:40:56.881244 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG oslo_concurrency.lockutils [None req-7841b808-daec-4533-8145-c781c97565ed admin admin] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:40:56.881655 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: DEBUG oslo_concurrency.lockutils [None req-7841b808-daec-4533-8145-c781c97565ed admin admin] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112114) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:40:56.904002 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: INFO nova.api.openstack.requestlog [None req-7841b808-daec-4533-8145-c781c97565ed admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.080092 Sep 06 22:40:56.904539 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: [pid: 112114|app: 0|req: 39/76] 10.222.0.39 () {60 vars in 1193 bytes} [Tue Sep 6 22:40:56 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:41:54.162903 dv-cinder-852208-20-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 06 22:41:54.163789 dv-cinder-852208-20-iscsi devstack@n-api.service[112112]: Tue Sep 6 22:41:54 2022 - graceful shutdown triggered... Sep 06 22:41:54.164283 dv-cinder-852208-20-iscsi devstack@n-api.service[112113]: Gracefully killing worker 1 (pid: 112113)... Sep 06 22:41:54.164642 dv-cinder-852208-20-iscsi devstack@n-api.service[112114]: Gracefully killing worker 2 (pid: 112114)... Sep 06 22:41:55.164931 dv-cinder-852208-20-iscsi devstack@n-api.service[112112]: worker 1 buried after 1 seconds Sep 06 22:41:55.165352 dv-cinder-852208-20-iscsi devstack@n-api.service[112112]: worker 2 buried after 1 seconds Sep 06 22:41:55.165352 dv-cinder-852208-20-iscsi devstack@n-api.service[112112]: goodbye to uWSGI. Sep 06 22:41:55.166564 dv-cinder-852208-20-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 06 22:41:55.167115 dv-cinder-852208-20-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 06 22:41:55.169963 dv-cinder-852208-20-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 06 22:41:55.179856 dv-cinder-852208-20-iscsi devstack@n-api.service[127069]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 06 22:41:55.181865 dv-cinder-852208-20-iscsi devstack@n-api.service[127069]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 6 22:41:55 2022] *** Sep 06 22:41:55.181865 dv-cinder-852208-20-iscsi devstack@n-api.service[127069]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 06 22:41:55.181865 dv-cinder-852208-20-iscsi devstack@n-api.service[127069]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 06 22:41:55.181865 dv-cinder-852208-20-iscsi devstack@n-api.service[127069]: nodename: dv-cinder-852208-20-iscsi Sep 06 22:41:55.181865 dv-cinder-852208-20-iscsi devstack@n-api.service[127069]: machine: x86_64 Sep 06 22:41:55.181865 dv-cinder-852208-20-iscsi devstack@n-api.service[127069]: clock source: unix Sep 06 22:41:55.181865 dv-cinder-852208-20-iscsi devstack@n-api.service[127069]: pcre jit disabled Sep 06 22:41:55.181865 dv-cinder-852208-20-iscsi devstack@n-api.service[127069]: detected number of CPU cores: 4 Sep 06 22:41:55.181865 dv-cinder-852208-20-iscsi devstack@n-api.service[127069]: current working directory: / Sep 06 22:41:55.181865 dv-cinder-852208-20-iscsi devstack@n-api.service[127069]: detected binary path: /usr/bin/uwsgi-core Sep 06 22:41:55.181865 dv-cinder-852208-20-iscsi devstack@n-api.service[127069]: your processes number limit is 47680 Sep 06 22:41:55.182687 dv-cinder-852208-20-iscsi devstack@n-api.service[127069]: your memory page size is 4096 bytes Sep 06 22:41:55.182687 dv-cinder-852208-20-iscsi devstack@n-api.service[127069]: detected max file descriptor number: 2048 Sep 06 22:41:55.182687 dv-cinder-852208-20-iscsi devstack@n-api.service[127069]: lock engine: pthread robust mutexes Sep 06 22:41:55.182687 dv-cinder-852208-20-iscsi devstack@n-api.service[127069]: thunder lock: enabled Sep 06 22:41:55.182687 dv-cinder-852208-20-iscsi devstack@n-api.service[127069]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 06 22:41:55.182687 dv-cinder-852208-20-iscsi devstack@n-api.service[127069]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 06 22:41:55.232664 dv-cinder-852208-20-iscsi devstack@n-api.service[127069]: Python main interpreter initialized at 0x563262a679c0 Sep 06 22:41:55.232664 dv-cinder-852208-20-iscsi devstack@n-api.service[127069]: python threads support enabled Sep 06 22:41:55.232664 dv-cinder-852208-20-iscsi devstack@n-api.service[127069]: your server socket listen backlog is limited to 100 connections Sep 06 22:41:55.232664 dv-cinder-852208-20-iscsi devstack@n-api.service[127069]: your mercy for graceful operations on workers is 90 seconds Sep 06 22:41:55.233173 dv-cinder-852208-20-iscsi devstack@n-api.service[127069]: mapped 403077 bytes (393 KB) for 2 cores Sep 06 22:41:55.233296 dv-cinder-852208-20-iscsi devstack@n-api.service[127069]: *** Operational MODE: preforking *** Sep 06 22:41:55.233614 dv-cinder-852208-20-iscsi devstack@n-api.service[127069]: *** uWSGI is running in multiple interpreter mode *** Sep 06 22:41:55.233614 dv-cinder-852208-20-iscsi devstack@n-api.service[127069]: spawned uWSGI master process (pid: 127069) Sep 06 22:41:55.233824 dv-cinder-852208-20-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 06 22:41:55.234099 dv-cinder-852208-20-iscsi devstack@n-api.service[127069]: spawned uWSGI worker 1 (pid: 127087, cores: 1) Sep 06 22:41:55.234959 dv-cinder-852208-20-iscsi devstack@n-api.service[127069]: spawned uWSGI worker 2 (pid: 127088, cores: 1) Sep 06 22:41:55.235122 dv-cinder-852208-20-iscsi devstack@n-api.service[127069]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 06 22:41:55.896012 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 06 22:41:55.923989 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 06 22:41:57.055043 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 22:41:57.055043 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: from cryptography.utils import int_from_bytes Sep 06 22:41:57.055659 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 22:41:57.055659 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: from cryptography.utils import int_from_bytes Sep 06 22:41:57.109601 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 22:41:57.109601 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: from cryptography.utils import int_from_bytes Sep 06 22:41:57.110082 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 22:41:57.110082 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: from cryptography.utils import int_from_bytes Sep 06 22:41:59.490348 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 22:41:59.490908 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 22:41:59.491212 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 22:41:59.491421 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 22:41:59.491652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 22:41:59.492037 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.492356 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.492672 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.493021 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.493352 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.493660 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.493978 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.494288 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.494616 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.494871 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.495183 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.495672 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-20-iscsi {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.495993 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.496307 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.496608 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.496948 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.497252 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.497573 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.497874 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.498371 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.499807 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.499807 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.499807 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.500100 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.500367 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.500685 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.501085 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.501600 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.502034 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.502346 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.502761 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-20-iscsi {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.503084 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.503395 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.503710 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.504120 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.504430 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.504739 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.505076 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.505407 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.505708 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.506035 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.506349 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.506674 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.506984 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.507282 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.507594 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.507896 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.508210 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.508509 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.508840 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.509096 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.509397 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.509717 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.510031 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.510348 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.510593 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.510837 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.511150 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.511462 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.511766 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.512067 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.512367 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.512682 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.513001 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.513308 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.513607 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.513903 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.514223 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.514532 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.514851 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.515363 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.515548 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.515851 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.516097 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.516415 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.518105 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.518105 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.518403 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.521122 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.521122 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.521122 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.521122 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.521122 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.521122 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.521122 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.521122 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.522378 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.522378 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.522378 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.522378 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.522378 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.522378 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.523204 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.523204 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.523204 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.523666 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.523808 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.524558 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.524558 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.524925 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.524925 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.525217 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.525506 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.525810 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.526130 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.526446 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.526751 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.527049 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.527349 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.527649 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.527964 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.528265 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.528564 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.529358 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.529358 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.529700 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.529860 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.530091 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.530388 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.530701 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.530998 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.531296 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.531609 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.531901 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.532938 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.533484 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.533848 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.534453 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.534453 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.534789 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.535146 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.535302 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.535633 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.535957 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.536265 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.536571 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.537304 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.537304 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.537516 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.537846 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.538189 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.538499 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.538828 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.539155 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.539477 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.539785 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.540095 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.540422 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.540729 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.541062 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.541369 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.541715 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.541994 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.542334 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.542634 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.542946 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.543259 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.543564 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.543876 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.544199 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.544519 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.544853 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.545202 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.545551 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.545863 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.546183 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.546504 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.546811 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.547116 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.547427 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.547832 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.548143 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.548453 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.548786 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.549101 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.552832 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.552832 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.552832 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.552832 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.552832 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.552832 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.552832 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.552832 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.553441 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.553441 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.553441 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.553441 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.553441 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.553441 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.553837 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.554231 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.554231 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.554559 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.554836 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.555138 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.555459 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.555794 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.556102 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.556437 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.556740 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.557075 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.557384 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.557689 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.557993 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.558304 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.558611 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.558913 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.559239 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.559545 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.559849 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.560167 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.560467 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.560788 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.561129 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.561435 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.561741 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.562050 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.562355 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.562683 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.562984 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.563338 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.563716 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.564102 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.564407 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.564729 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.565077 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.565388 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.565687 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.565991 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.566290 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.566589 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.566889 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.567191 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.567489 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.567789 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.568088 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.568392 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.568695 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.569069 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.569379 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.569682 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.569981 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.570283 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.570626 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.574521 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.574521 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.574521 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.574521 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.574521 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.574521 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.574521 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.574521 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.575974 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.575974 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.575974 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.575974 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.575974 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.575974 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.575974 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.575974 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.577111 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.577111 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.577111 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.577111 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.577655 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.577812 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.580316 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.580316 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.580316 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.580316 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.580316 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.580316 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.581908 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.581908 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.581908 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.581908 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.581908 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.582622 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.582622 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.582904 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.583101 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.583405 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.583716 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.584047 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.584381 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.584684 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.585038 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.585356 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.585665 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.585971 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.586278 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.586579 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.586881 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.587188 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.587498 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.587805 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.588111 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.588414 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.588722 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.589070 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.589373 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.589679 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.589984 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.590303 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.590609 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.590927 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.591244 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.591557 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.591865 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.592153 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.592458 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.592792 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.593077 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.593389 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.593738 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.593990 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 22:41:59.594526 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.594859 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 22:41:59.595046 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.595046 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.595328 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 22:41:59.595562 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.595562 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.595885 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 22:41:59.596033 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.596331 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 22:41:59.597067 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.597223 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.597370 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.597515 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.597667 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.597823 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.597969 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.598123 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.598287 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.598432 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.598585 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.598745 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.598900 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.599053 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.599199 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.599351 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.599508 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.599661 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.599814 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.599961 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.600126 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.600279 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.600438 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.600438 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.600736 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-20-iscsi {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.600917 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.601065 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.601210 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.601367 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.601521 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.601775 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.601775 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.602198 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.602367 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.602529 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.602683 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.602829 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.602980 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.603137 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.603137 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.603437 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.603616 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.603951 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.604212 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.604376 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.604522 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.604713 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.604919 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.605077 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.605232 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.605378 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.605523 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.605676 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.605828 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.605988 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.606135 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.606314 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.606633 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.606801 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.606956 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.607112 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.607259 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.607403 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-20-iscsi {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.607548 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.607693 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.607922 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.607922 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.608200 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.608346 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.608510 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.608665 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.608829 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.608992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.609148 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.609294 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.609439 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.609593 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.609750 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.609908 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.610060 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.610732 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.610885 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.611135 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.611491 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.611660 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.611916 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.612070 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.612239 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.612497 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.612657 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.613052 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.613291 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.613441 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.613597 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.613744 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.614020 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.614200 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.614434 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.614594 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.614806 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.614966 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.615123 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.615276 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.615430 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.615576 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.615734 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.615888 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.616051 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.616204 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.616349 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.616504 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.616504 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.617027 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.617027 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.617309 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.617454 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.617620 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.617768 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.617914 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.618069 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.618225 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.618383 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.618537 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.618682 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.618835 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.618980 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.619124 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.619281 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.619428 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.619587 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.619741 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.619905 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.620051 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.620051 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.620345 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.620498 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.620651 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.620825 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.620978 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.621137 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.621290 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.621444 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.621596 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.621755 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.621951 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.622109 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.622262 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.622408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.622579 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.622734 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.622888 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.623042 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.623191 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.623335 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.623479 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.623623 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.623776 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.623939 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.624181 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.624340 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.624568 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.624720 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.624927 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.625131 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.625287 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.625443 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.625588 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.625742 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.625981 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.626139 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.626297 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.626450 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.626596 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.626775 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.626775 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.627057 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.627057 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.627341 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.627486 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.627645 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.627791 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.627935 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.628079 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.628236 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.628388 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.628602 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.628752 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.628985 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.629130 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.629295 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.629446 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.629611 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.629764 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.629921 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.630081 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.630251 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.630413 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.630565 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.630722 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.630874 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.631025 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.631175 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.631336 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.631495 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.631654 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.631806 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.631965 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.632124 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.632295 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.632455 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.632614 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.632796 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.632966 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.633126 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.633290 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.633451 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.633609 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.633760 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.633919 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.634079 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.634321 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.634492 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.634741 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.634900 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.635052 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.635210 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.635369 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.635522 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.635682 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.635834 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.635983 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.636134 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.636291 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.636443 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.636614 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.636794 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.636964 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.637116 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.637275 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.637427 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.637588 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.637740 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.637899 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.638052 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.638052 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.638339 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.638339 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.638728 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.638728 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.639026 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.639185 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.639350 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.639350 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.639646 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.639799 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.639958 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.640118 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.640279 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.640440 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.640602 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.640753 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.640941 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.641093 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.641258 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.641950 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.642465 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.642707 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.642865 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.643027 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.643205 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.643366 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.643526 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.643526 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.643826 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.644023 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.644178 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.644347 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.644509 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.644662 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.644891 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 22:41:59.645063 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.645273 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.645436 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.645595 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.645756 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.645920 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.646088 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.646248 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.646401 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.646559 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.646711 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.646868 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.647039 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.647039 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.647339 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.647496 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.647655 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.647828 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.647980 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.648132 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.648295 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.648295 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.648593 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.648769 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.648932 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.649082 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.649233 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.649395 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.649548 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.649707 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.649870 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.650029 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.650189 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.650341 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.650500 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.650500 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.650809 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.650961 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.651111 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.651111 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.651409 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.651567 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.651719 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.651886 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.652039 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.652196 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.652359 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.652359 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.652663 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.652832 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.653015 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.653188 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.653356 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.653518 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.653671 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.653840 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.653993 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.654157 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.654309 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.654462 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.654613 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.654764 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.654924 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.655090 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.655259 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.655411 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.655563 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.655721 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.655890 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.656053 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.656212 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.656365 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.656529 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.656690 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.656886 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.657126 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.657297 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.657452 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.657605 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.657757 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.657923 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.658095 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.658248 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.658408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.658561 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.658721 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.658882 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.659043 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.659197 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.659349 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.659508 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.659669 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.659837 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.659991 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.660161 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.660321 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.660474 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.660626 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.660844 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.661015 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.661167 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.661318 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.661470 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.661635 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.661797 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.661957 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.662126 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.662293 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.662446 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.662446 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.662752 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.662912 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.663070 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.663227 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.663397 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.663606 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.663770 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.663924 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.664075 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.664237 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.664396 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.664594 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.664749 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.664938 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.665099 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.665258 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.665419 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.665571 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.665730 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.665882 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.666033 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.666184 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.666360 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.666512 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.666663 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.666813 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.666965 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.667116 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.667277 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.667436 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.667603 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.667762 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.667914 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.668065 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.668227 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.668393 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.668569 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.668720 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.668927 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.669093 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.669246 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.669396 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.669548 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.669705 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.669858 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.670018 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.670171 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.670321 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.670481 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.670632 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.670793 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.670954 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.671115 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.671267 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.671418 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.671575 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.671727 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.671955 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.672117 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.672277 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.672448 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.672600 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.673303 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.673469 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.673655 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.673875 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.673998 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.674094 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.674212 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.674303 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.674388 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.674480 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.674573 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.674693 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.674780 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.674882 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.674977 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.675063 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.675160 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.675258 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.675356 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.675441 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.675532 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.675623 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.675715 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.675814 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.675899 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.675981 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.676065 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.676156 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.676247 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.676345 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.676431 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.676521 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.676612 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.676703 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.676827 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.676924 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.677017 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.677107 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.677192 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.677297 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.677388 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.677529 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.677624 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.677624 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.677785 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.677876 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.677990 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.678085 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.678085 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.678254 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.678345 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.678429 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.678521 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.678627 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.678713 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.678796 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.678886 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.678978 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.679070 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.679155 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.679244 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.679335 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.679419 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.679502 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.679594 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.679677 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.679760 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.679851 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.679942 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.680034 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.680125 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.680216 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.680300 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.680382 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.680465 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.680556 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.680722 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.680856 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.680966 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.681060 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.681152 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.681245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.681330 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.681412 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.681412 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.681605 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.681698 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.681796 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.681882 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.681965 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.682047 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.682130 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.682224 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.682316 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.682407 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.682498 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.682582 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.682665 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.682760 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.682846 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.682942 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.683038 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.683130 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.683221 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.683314 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.683398 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.683481 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.683578 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.683662 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.683752 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.683865 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.683953 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.684043 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.684127 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.684210 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.684306 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.684456 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.684577 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.684891 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.685008 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.685190 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.685363 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.685518 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.685677 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.685849 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.686009 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.686174 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.686335 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.686487 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.686638 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.686796 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.686957 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.687118 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.687270 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.687446 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.687604 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.687763 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.687927 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.688089 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.688248 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.688988 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.689246 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.689570 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.689751 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.689916 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.690071 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.690237 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.690390 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.690543 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.690709 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.690873 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.691034 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.691188 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.691347 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.691508 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.691692 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.691877 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.692032 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.692184 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.692342 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.692501 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.692663 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.692860 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.692860 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.693152 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.693152 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.693439 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.693439 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.693749 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.693908 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.694060 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.694218 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.694381 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.694540 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.694701 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.694872 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.695051 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.695205 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.695367 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.695518 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.695670 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.695821 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.695981 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.696140 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.696301 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.696454 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.696605 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.696605 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.696939 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.697106 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.697271 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.697425 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.697576 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.697728 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.697878 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.698042 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.698194 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.698347 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.698517 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.698517 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.698814 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.698985 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.699145 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.699297 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.699448 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.699608 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.699767 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.699929 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.700081 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.700241 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.700393 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.700551 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.700704 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.700918 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.701081 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.701233 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.701512 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.701682 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.701845 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.702005 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.702157 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.702317 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.702469 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.702618 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.702844 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.702999 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.703162 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.703162 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.703466 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.703618 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.703778 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.703965 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.704226 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.704397 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.704559 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.704712 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.704891 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.705045 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.705217 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.705382 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.705541 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.705700 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.705853 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.706019 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.706172 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.706330 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.706489 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.706649 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.706808 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.706975 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.707135 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.707299 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.707450 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.707610 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.707762 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.707924 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.708084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.708237 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.708388 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.708558 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.708720 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.708926 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.709081 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.709232 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.709399 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.709399 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.709697 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.709849 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.710010 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.710168 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.710327 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.710486 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.710652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.710804 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.710955 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.711107 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.711259 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.711420 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.711585 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.711585 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.711873 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.711873 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.712168 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.712320 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.712481 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.712634 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.712878 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.713048 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.713202 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.713352 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.713528 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.713680 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.713840 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.713992 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.714152 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.714349 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.714955 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.715065 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.715185 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.715285 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.715381 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.715483 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.715578 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.715708 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.715793 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.715866 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.715957 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.716052 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.716145 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.716231 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.716321 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.716406 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.716503 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.716588 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.716670 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.716753 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.716876 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.716974 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.717075 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.717161 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.717244 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.717334 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.717418 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.717510 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.717603 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.717687 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.717786 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.717878 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.717970 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.718054 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.718150 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.718244 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.718339 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.718430 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.718521 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.718619 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.718704 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.718825 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.719003 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.719160 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.719324 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.719490 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.720312 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.720473 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.720636 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.720822 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.720982 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.721148 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.721310 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.721462 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.721614 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.721766 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.722009 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.722176 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.722329 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.722481 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.722643 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.722803 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.722965 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.723155 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.723322 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.723477 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.723631 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.723789 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.723952 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.724115 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.724115 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.724412 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.724572 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.724733 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.724927 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.725088 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.725247 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.725399 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.725557 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.725720 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.725908 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.726066 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.726227 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.726387 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.726540 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.726705 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.726860 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.727019 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.727178 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.727330 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.727487 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.727648 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.727809 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.727961 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.728129 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.728288 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.728452 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.728605 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.728806 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.728978 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.729138 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.729299 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.729461 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.729621 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.729781 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.729941 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.730092 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.730262 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.730424 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.730595 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.730755 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.730907 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.731058 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.731219 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.731381 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.731534 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.731693 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.731852 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.732019 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.732182 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.732351 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.732512 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.732512 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.732818 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.732976 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.733141 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.733294 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.733453 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.733605 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.733756 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.733906 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.734070 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.734224 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.734392 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.734545 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.734702 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.734855 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.735018 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.735242 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.735907 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.736061 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.736213 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.736375 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.736528 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.736680 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.736869 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.737036 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.737188 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.737360 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.737360 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.737659 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.737821 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.737982 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.738134 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.738298 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.738452 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.738613 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.738766 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.738931 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.739085 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.739250 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.739404 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.739555 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.739707 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.739858 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.739858 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.740162 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.740321 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.740533 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.740698 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.740887 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.741062 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.741226 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.741377 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.741538 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.741697 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.741850 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.742010 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.742163 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.742314 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.742476 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.742628 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.742805 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.743040 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.743227 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.743382 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.743534 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.743686 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.743853 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.744013 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.744181 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.744341 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.744502 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.744656 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.744854 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.745022 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.745193 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.745363 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.745568 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.745739 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.745905 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.746057 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.746209 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.746209 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.746521 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.746684 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.746845 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.746999 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.747150 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.747320 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.747472 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.747638 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.747792 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.747943 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.748102 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.748263 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.748421 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.748597 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.748751 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.748929 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.749092 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.749255 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.749425 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.749587 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.749587 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.749885 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.750045 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.750196 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.750362 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.750523 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.750675 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.750850 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.751009 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.751160 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.751331 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.751483 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.751636 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.751795 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.751947 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.752098 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.752332 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.752492 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.752492 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.752839 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.753000 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.753162 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.753339 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.753492 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 22:41:59.753643 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.753643 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.753643 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.753643 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.753643 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.753643 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.754518 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.754518 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.754518 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.755402 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.755402 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.755402 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.755635 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.755944 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.756402 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.756598 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.756940 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.757261 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.757569 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.757898 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.758228 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.758545 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.758873 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.759298 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.759627 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.759943 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.760266 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.760597 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.760931 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.761242 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.761557 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.761865 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.762173 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.762499 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.762809 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.763123 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.763440 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.763752 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.764059 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.764363 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.764687 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.765020 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.765349 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.765664 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.765990 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.766315 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.766650 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.766982 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.767718 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.768031 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.768736 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.768736 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.769072 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.769307 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.769656 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.769991 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.770306 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.770621 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.770959 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.771287 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.771611 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.771925 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.772246 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.772576 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.772909 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.773220 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.773534 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.773841 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.774151 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.774459 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.774771 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.775078 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.775387 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.775696 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.776025 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.776333 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.776661 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.777073 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.777384 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.777692 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.777998 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.778345 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.778652 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.778985 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.779299 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.779627 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.779948 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.780265 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.780583 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.780923 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.781245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.781562 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.781878 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.782905 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.783228 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.783547 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.783866 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.784421 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.784780 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.785093 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.785411 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.785730 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.786052 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.786386 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.786675 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.786987 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.787304 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.787621 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.787948 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.788275 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.788607 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.788968 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.789289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.789609 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.789926 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.790252 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.790596 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.790913 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.791220 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.791533 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.791849 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.792162 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.792474 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.792802 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.793120 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.793431 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.793742 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.794049 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.794361 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.794674 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.794996 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.795332 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.795654 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.795968 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.796340 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.796595 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.797148 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.797471 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.797868 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.798203 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.798534 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.798855 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.799176 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.799509 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.799820 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.800131 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.800445 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.800768 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.801081 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.801408 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.801721 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.802028 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.802349 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.802661 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.803201 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.803551 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.803871 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.804198 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.804526 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.804868 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.805180 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.805505 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.805813 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.806120 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.806434 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.806745 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.807052 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.807357 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.807677 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.807983 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.808290 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.808603 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.809006 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.809339 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.809650 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.809957 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.810263 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.810577 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.810884 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.811191 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.811497 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.811802 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.812115 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.812417 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.812843 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.813156 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.813907 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO dbcounter [None req-c5631802-8f98-4545-863d-5f11e2ab4b02 None None] Registered counter for database nova_api Sep 06 22:41:59.814011 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.814358 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.814662 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.814969 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.815297 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.815608 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.815916 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.816235 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.816549 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.816871 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.817183 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.817541 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.817892 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.818209 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.818751 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.819091 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.819413 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.819749 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.820084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.820394 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.820701 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.821042 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.821369 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.821681 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.821995 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.822305 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.822615 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.822924 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.823234 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.823542 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.823850 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.824159 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.824468 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.824794 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.825107 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.825417 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.825724 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.826035 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.826378 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.826698 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.827011 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.827332 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.827647 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.827960 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.828267 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.828577 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.830521 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.830521 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.830521 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.830819 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.830916 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.831275 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.831592 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.831915 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.832238 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.832549 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.832899 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.833228 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.833544 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.833866 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.834178 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.834510 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.834852 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.835184 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.835286 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_db.sqlalchemy.engines [None req-c5631802-8f98-4545-863d-5f11e2ab4b02 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127087) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 22:41:59.835524 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.835819 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.836126 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.836433 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.836749 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.837089 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.837398 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.837707 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.838015 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.838327 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.838629 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.838934 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.839238 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.839542 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.839848 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.840149 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.840527 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.840794 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.841173 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.841385 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.841689 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.841903 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writer thread running {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 22:41:59.842072 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.842291 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.842596 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.842901 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.843207 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.843514 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.843847 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.844181 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.844495 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.844989 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.845310 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.845643 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.845943 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.846266 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.846589 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.846911 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.847223 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.847558 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.847874 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.848187 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.848502 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.848835 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.849152 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.849467 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.849797 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.850126 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.850435 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.850765 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.851085 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.851404 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.851721 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.852033 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.852365 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.852678 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.853015 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.853327 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.853642 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.853953 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.854268 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.854577 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.854887 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.855204 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.855519 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.855848 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.856178 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.856490 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.856837 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.857168 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.857513 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.857831 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.858177 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.858509 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.858824 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.859138 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.859445 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 22:41:59.859687 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 22:41:59.897163 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.context [None req-c5631802-8f98-4545-863d-5f11e2ab4b02 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2c8ddd81-1531-42c9-950d-068e09646658(cell1) {{(pid=127087) load_cells /opt/stack/nova/nova/context.py:464}} Sep 06 22:41:59.901146 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c5631802-8f98-4545-863d-5f11e2ab4b02 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:41:59.901613 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c5631802-8f98-4545-863d-5f11e2ab4b02 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:41:59.903187 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c5631802-8f98-4545-863d-5f11e2ab4b02 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:41:59.903895 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c5631802-8f98-4545-863d-5f11e2ab4b02 None None] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:41:59.904331 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c5631802-8f98-4545-863d-5f11e2ab4b02 None None] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:41:59.906325 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c5631802-8f98-4545-863d-5f11e2ab4b02 None None] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:41:59.908357 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO dbcounter [None req-c5631802-8f98-4545-863d-5f11e2ab4b02 None None] Registered counter for database nova_cell0 Sep 06 22:41:59.912318 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO dbcounter [None req-c5631802-8f98-4545-863d-5f11e2ab4b02 None None] Registered counter for database nova_cell1 Sep 06 22:41:59.919488 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_db.sqlalchemy.engines [None req-c5631802-8f98-4545-863d-5f11e2ab4b02 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127087) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 22:41:59.921288 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_db.sqlalchemy.engines [None req-c5631802-8f98-4545-863d-5f11e2ab4b02 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127087) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 22:41:59.922718 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO dbcounter [None req-409b4d8e-26a8-48c3-b65d-4efad031f66c None None] Registered counter for database nova_api Sep 06 22:41:59.926502 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writer thread running {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 22:41:59.932196 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writer thread running {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 22:41:59.943193 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_db.sqlalchemy.engines [None req-409b4d8e-26a8-48c3-b65d-4efad031f66c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 22:41:59.949682 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writer thread running {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 22:42:00.011354 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.context [None req-409b4d8e-26a8-48c3-b65d-4efad031f66c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2c8ddd81-1531-42c9-950d-068e09646658(cell1) {{(pid=127088) load_cells /opt/stack/nova/nova/context.py:464}} Sep 06 22:42:00.015337 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-409b4d8e-26a8-48c3-b65d-4efad031f66c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:42:00.015807 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-409b4d8e-26a8-48c3-b65d-4efad031f66c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:42:00.018253 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-409b4d8e-26a8-48c3-b65d-4efad031f66c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:42:00.018979 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-409b4d8e-26a8-48c3-b65d-4efad031f66c None None] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:42:00.019427 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-409b4d8e-26a8-48c3-b65d-4efad031f66c None None] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:42:00.021447 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-409b4d8e-26a8-48c3-b65d-4efad031f66c None None] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:42:00.023451 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO dbcounter [None req-409b4d8e-26a8-48c3-b65d-4efad031f66c None None] Registered counter for database nova_cell0 Sep 06 22:42:00.027453 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO dbcounter [None req-409b4d8e-26a8-48c3-b65d-4efad031f66c None None] Registered counter for database nova_cell1 Sep 06 22:42:00.034985 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_db.sqlalchemy.engines [None req-409b4d8e-26a8-48c3-b65d-4efad031f66c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 22:42:00.036367 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_db.sqlalchemy.engines [None req-409b4d8e-26a8-48c3-b65d-4efad031f66c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 22:42:00.043027 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writer thread running {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 22:42:00.045323 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writer thread running {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 22:42:00.074631 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO dbcounter [None req-c5631802-8f98-4545-863d-5f11e2ab4b02 None None] Registered counter for database nova_cell0 Sep 06 22:42:00.082317 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_db.sqlalchemy.engines [None req-c5631802-8f98-4545-863d-5f11e2ab4b02 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127087) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 22:42:00.086732 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writer thread running {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 22:42:00.196705 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO dbcounter [None req-409b4d8e-26a8-48c3-b65d-4efad031f66c None None] Registered counter for database nova_cell0 Sep 06 22:42:00.205342 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_db.sqlalchemy.engines [None req-409b4d8e-26a8-48c3-b65d-4efad031f66c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 22:42:00.210099 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writer thread running {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 22:42:00.405787 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: WARNING keystonemiddleware.auth_token [None req-c5631802-8f98-4545-863d-5f11e2ab4b02 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 22:42:00.413689 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: WARNING keystonemiddleware.auth_token [None req-c5631802-8f98-4545-863d-5f11e2ab4b02 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 22:42:00.542493 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: WARNING keystonemiddleware.auth_token [None req-409b4d8e-26a8-48c3-b65d-4efad031f66c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 22:42:00.550469 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: WARNING keystonemiddleware.auth_token [None req-409b4d8e-26a8-48c3-b65d-4efad031f66c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 22:42:00.758717 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: WARNING keystonemiddleware.auth_token [None req-c5631802-8f98-4545-863d-5f11e2ab4b02 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 22:42:00.765077 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: WARNING keystonemiddleware.auth_token [None req-c5631802-8f98-4545-863d-5f11e2ab4b02 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 22:42:00.771743 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563262a679c0 pid: 127087 (default app) Sep 06 22:42:00.913501 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: WARNING keystonemiddleware.auth_token [None req-409b4d8e-26a8-48c3-b65d-4efad031f66c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 22:42:00.919738 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: WARNING keystonemiddleware.auth_token [None req-409b4d8e-26a8-48c3-b65d-4efad031f66c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 22:42:00.925365 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563262a679c0 pid: 127088 (default app) Sep 06 22:42:37.559858 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=3 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:37.560702 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=3 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:37.561996 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=3 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:37.563171 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=3 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:38.780220 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-07f78825-4a98-429d-91d3-e3cd32ae0d96 tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] Action: 'create', calling method: .version_select at 0x7f9c5072f3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-527145819"}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:42:40.336896 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-07f78825-4a98-429d-91d3-e3cd32ae0d96 tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.790397 Sep 06 22:42:40.338071 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 1/1] 10.222.0.39 () {60 vars in 1155 bytes} [Tue Sep 6 22:42:37 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2793 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 06 22:42:40.365499 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=3 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:40.366782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=3 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:40.367729 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=3 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:40.368488 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=3 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:42:40.902849 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4ab1ac18-1069-4ea3-93e4-33289bc47ace tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] Calling method '.version_select at 0x7f9c507770d0>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:42:41.380482 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4ab1ac18-1069-4ea3-93e4-33289bc47ace tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/dbe2a874-7b51-40ce-9361-3d02ccd572cf" status: 200 len: 345 microversion: 2.1 time: 1.030416 Sep 06 22:42:41.388794 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 1/2] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Sep 6 22:42:40 2022] GET /compute/v2.1/os-volumes/dbe2a874-7b51-40ce-9361-3d02ccd572cf => generated 345 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:42:41.408062 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-2b2fef41-e225-4b86-9bcd-e44ab309c1af tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] Action: 'create', calling method: .version_select at 0x7f9c506121f0>, body: {"snapshot": {"volume_id": "dbe2a874-7b51-40ce-9361-3d02ccd572cf", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2126166906"}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:42:41.879558 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-2b2fef41-e225-4b86-9bcd-e44ab309c1af tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] 10.222.0.39 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.488669 Sep 06 22:42:41.880066 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 2/3] 10.222.0.39 () {60 vars in 1162 bytes} [Tue Sep 6 22:42:41 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:42:41.892060 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ba2917bf-c5f5-4936-9665-5ede1621bf35 tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] Calling method '.version_select at 0x7f9c50641280>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:42:41.957645 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ba2917bf-c5f5-4936-9665-5ede1621bf35 tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/05cb87f2-d07f-44de-9a32-6c816d7799e0" status: 200 len: 287 microversion: 2.1 time: 0.070082 Sep 06 22:42:41.958536 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 2/4] 10.222.0.39 () {58 vars in 1251 bytes} [Tue Sep 6 22:42:41 2022] GET /compute/v2.1/os-snapshots/05cb87f2-d07f-44de-9a32-6c816d7799e0 => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:42:41.970017 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-aebb940a-4fa7-4a74-a36c-d729e1dc768e tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] Calling method '.version_select at 0x7f9c505994c0>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:42:42.024651 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-aebb940a-4fa7-4a74-a36c-d729e1dc768e tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.058753 Sep 06 22:42:42.025881 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 3/5] 10.222.0.39 () {58 vars in 1140 bytes} [Tue Sep 6 22:42:41 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:42:42.038673 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0e3e8663-491a-489d-a8dd-e362031a10d7 tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] Calling method '.version_select at 0x7f9c506419d0>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:42:42.075482 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0e3e8663-491a-489d-a8dd-e362031a10d7 tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/05cb87f2-d07f-44de-9a32-6c816d7799e0" status: 200 len: 287 microversion: 2.1 time: 0.040992 Sep 06 22:42:42.076535 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 3/6] 10.222.0.39 () {58 vars in 1251 bytes} [Tue Sep 6 22:42:42 2022] GET /compute/v2.1/os-snapshots/05cb87f2-d07f-44de-9a32-6c816d7799e0 => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 22:42:43.090114 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f61954d7-30d5-4796-83f7-94d983434ddc tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] Calling method '.version_select at 0x7f9c50599ca0>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:42:43.182476 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-f61954d7-30d5-4796-83f7-94d983434ddc tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/05cb87f2-d07f-44de-9a32-6c816d7799e0" status: 200 len: 287 microversion: 2.1 time: 0.096518 Sep 06 22:42:43.183518 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 4/7] 10.222.0.39 () {58 vars in 1251 bytes} [Tue Sep 6 22:42:43 2022] GET /compute/v2.1/os-snapshots/05cb87f2-d07f-44de-9a32-6c816d7799e0 => generated 287 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:42:44.223665 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f1986062-ccfe-4ac0-b163-8a9dd73b86fd tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] Calling method '.version_select at 0x7f9c50641d30>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:42:44.312956 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f1986062-ccfe-4ac0-b163-8a9dd73b86fd tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/05cb87f2-d07f-44de-9a32-6c816d7799e0" status: 200 len: 287 microversion: 2.1 time: 0.120357 Sep 06 22:42:44.314078 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 4/8] 10.222.0.39 () {58 vars in 1251 bytes} [Tue Sep 6 22:42:44 2022] GET /compute/v2.1/os-snapshots/05cb87f2-d07f-44de-9a32-6c816d7799e0 => generated 287 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:42:45.326695 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-476eec00-4764-4375-8ad8-00bf43f6be46 tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] Calling method '.version_select at 0x7f9c505993a0>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:42:45.394428 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-476eec00-4764-4375-8ad8-00bf43f6be46 tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/05cb87f2-d07f-44de-9a32-6c816d7799e0" status: 200 len: 288 microversion: 2.1 time: 0.071879 Sep 06 22:42:45.395221 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 5/9] 10.222.0.39 () {58 vars in 1251 bytes} [Tue Sep 6 22:42:45 2022] GET /compute/v2.1/os-snapshots/05cb87f2-d07f-44de-9a32-6c816d7799e0 => generated 288 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:42:45.407673 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-13deed66-7d32-495d-8c6f-05d3ca046580 tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] Calling method '.version_select at 0x7f9c50641550>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:42:45.530435 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-13deed66-7d32-495d-8c6f-05d3ca046580 tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] 10.222.0.39 "DELETE /compute/v2.1/os-snapshots/05cb87f2-d07f-44de-9a32-6c816d7799e0" status: 202 len: 0 microversion: 2.1 time: 0.127331 Sep 06 22:42:45.532122 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 5/10] 10.222.0.39 () {58 vars in 1254 bytes} [Tue Sep 6 22:42:45 2022] DELETE /compute/v2.1/os-snapshots/05cb87f2-d07f-44de-9a32-6c816d7799e0 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 22:42:45.540316 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-c319f89a-8c82-4836-99e4-380f9d6a6add tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] Calling method '.version_select at 0x7f9c50612ee0>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:42:45.626927 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-c319f89a-8c82-4836-99e4-380f9d6a6add tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/05cb87f2-d07f-44de-9a32-6c816d7799e0" status: 200 len: 287 microversion: 2.1 time: 0.089385 Sep 06 22:42:45.627375 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 6/11] 10.222.0.39 () {58 vars in 1251 bytes} [Tue Sep 6 22:42:45 2022] GET /compute/v2.1/os-snapshots/05cb87f2-d07f-44de-9a32-6c816d7799e0 => generated 287 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:42:46.640104 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2d21d7f8-9c9e-4991-b9f0-e4661bc0ade4 tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] Calling method '.version_select at 0x7f9c50603160>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:42:46.700254 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2d21d7f8-9c9e-4991-b9f0-e4661bc0ade4 tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/05cb87f2-d07f-44de-9a32-6c816d7799e0" status: 200 len: 287 microversion: 2.1 time: 0.064603 Sep 06 22:42:46.701070 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 6/12] 10.222.0.39 () {58 vars in 1251 bytes} [Tue Sep 6 22:42:46 2022] GET /compute/v2.1/os-snapshots/05cb87f2-d07f-44de-9a32-6c816d7799e0 => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:42:47.722630 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-7f674fbf-a18d-4f09-8ad5-48358097d222 tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] Calling method '.version_select at 0x7f9c505993a0>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:42:47.781040 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-7f674fbf-a18d-4f09-8ad5-48358097d222 tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/05cb87f2-d07f-44de-9a32-6c816d7799e0" status: 200 len: 287 microversion: 2.1 time: 0.070186 Sep 06 22:42:47.783273 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 7/13] 10.222.0.39 () {58 vars in 1251 bytes} [Tue Sep 6 22:42:47 2022] GET /compute/v2.1/os-snapshots/05cb87f2-d07f-44de-9a32-6c816d7799e0 => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:42:48.797213 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-27925744-1944-46bd-842a-26c417861895 tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] Calling method '.version_select at 0x7f9c506414c0>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:42:48.885654 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-27925744-1944-46bd-842a-26c417861895 tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/05cb87f2-d07f-44de-9a32-6c816d7799e0" status: 200 len: 287 microversion: 2.1 time: 0.093858 Sep 06 22:42:48.887233 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 7/14] 10.222.0.39 () {58 vars in 1251 bytes} [Tue Sep 6 22:42:48 2022] GET /compute/v2.1/os-snapshots/05cb87f2-d07f-44de-9a32-6c816d7799e0 => generated 287 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:42:49.901352 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9e05a519-1ad8-4abe-8c56-4fe2ef7dbe44 tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] Calling method '.version_select at 0x7f9c50599c10>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:42:49.972550 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9e05a519-1ad8-4abe-8c56-4fe2ef7dbe44 tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/05cb87f2-d07f-44de-9a32-6c816d7799e0" status: 200 len: 287 microversion: 2.1 time: 0.076372 Sep 06 22:42:49.973571 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 8/15] 10.222.0.39 () {58 vars in 1251 bytes} [Tue Sep 6 22:42:49 2022] GET /compute/v2.1/os-snapshots/05cb87f2-d07f-44de-9a32-6c816d7799e0 => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:42:50.987658 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9fe19007-9396-40d4-bcdb-ac9842e4155f tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] Calling method '.version_select at 0x7f9c50641af0>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:42:51.064433 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9fe19007-9396-40d4-bcdb-ac9842e4155f tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/05cb87f2-d07f-44de-9a32-6c816d7799e0" status: 200 len: 287 microversion: 2.1 time: 0.080540 Sep 06 22:42:51.068525 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 8/16] 10.222.0.39 () {58 vars in 1251 bytes} [Tue Sep 6 22:42:50 2022] GET /compute/v2.1/os-snapshots/05cb87f2-d07f-44de-9a32-6c816d7799e0 => generated 287 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:42:51.767244 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-abfd7eb5-3c25-46e7-ab3e-f1b555c128c4 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Action: 'create', calling method: .version_select at 0x7f9c5072f3a0>, body: {"keypair": {"name": "tempest-keypair-1014378103", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOqhnLZeQozRBWcxns/ksk5S/nbNcr58dxL1eZP/5xPAub1CwtjMuqGsU/tjkC1APr0IKmZW3z4i9WNQWLCGCwyTqi24YH2mk+WQ2geyWKyJ5LzqA2Hms5/f8TvfE+lzA=="}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:42:51.882361 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-37483e23-c21d-4a12-b91a-cf66c61d8eb6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2008752719", "imageRef": "93326d5e-4826-431e-9ad1-6ee2d44e48d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:42:51.961314 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-abfd7eb5-3c25-46e7-ab3e-f1b555c128c4 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Getting quotas for project 817010ab38864d8aafb61140eb176da1. Resources: {'key_pairs'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 22:42:51.983408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-abfd7eb5-3c25-46e7-ab3e-f1b555c128c4 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Getting quotas for user 4dd9f0bff3044d7db561dff21ac0e7ff and project 817010ab38864d8aafb61140eb176da1. Resources: {'key_pairs'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 22:42:52.122916 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-abfd7eb5-3c25-46e7-ab3e-f1b555c128c4 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.990366 Sep 06 22:42:52.123741 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 9/17] 10.222.0.39 () {60 vars in 1159 bytes} [Tue Sep 6 22:42:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:42:52.143186 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-00f063f5-1eb5-4cc8-88ed-c5795c28f8d5 tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] Calling method '.version_select at 0x7f9c50582820>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:42:52.175089 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.network.neutron [None req-37483e23-c21d-4a12-b91a-cf66c61d8eb6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] validate_networks() for [('06b475d5-934b-4826-b952-a6c0a64b3745', None, None, None, None, None)] {{(pid=127088) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 22:42:52.189183 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-00f063f5-1eb5-4cc8-88ed-c5795c28f8d5 tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] HTTP exception thrown: Snapshot 05cb87f2-d07f-44de-9a32-6c816d7799e0 could not be found. Sep 06 22:42:52.194204 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-00f063f5-1eb5-4cc8-88ed-c5795c28f8d5 tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] Request method failure captured: Sep 06 22:42:52.194204 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: request: GET /compute/v2.1/os-snapshots/05cb87f2-d07f-44de-9a32-6c816d7799e0 HTTP/1.1 Sep 06 22:42:52.194204 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept: application/json Sep 06 22:42:52.194204 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Sep 06 22:42:52.194204 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Connection: close Sep 06 22:42:52.194204 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Length: 0 Sep 06 22:42:52.194204 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Type: application/json Sep 06 22:42:52.194204 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Host: 10.222.0.39 Sep 06 22:42:52.194204 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Sep 06 22:42:52.194204 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.12 Sep 06 22:42:52.194204 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABjF8zd_SLnAWjB6Y08bWElzrPkzh4PmSfezlXg7UTR2C59HmKFLIheRVl2UpPDpBi3_rPYxJkIWR9xcLxgWXe8IqFySWsJ6uc30TcLxNXBvnctj2cYfF5d8TJY8BPTIRsjdHc3LR4YnyjO5cZO0g83OEkZ9FybVkC3BWeGkfSrOPa5MkE Sep 06 22:42:52.194204 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Sep 06 22:42:52.194204 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Sep 06 22:42:52.194204 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Sep 06 22:42:52.194204 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Sep 06 22:42:52.194204 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Sep 06 22:42:52.194204 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Sep 06 22:42:52.194204 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Id: 200607d5d1f8491e9168dddd9903b779 Sep 06 22:42:52.194204 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1210987001 Sep 06 22:42:52.194204 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Role: reader,member Sep 06 22:42:52.194204 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Sep 06 22:42:52.195296 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/200607d5d1f8491e9168dddd9903b779"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_200607d5d1f8491e9168dddd9903b779"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/200607d5d1f8491e9168dddd9903b779"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/200607d5d1f8491e9168dddd9903b779"}]}] Sep 06 22:42:52.195296 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1210987001 Sep 06 22:42:52.195296 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 200607d5d1f8491e9168dddd9903b779 Sep 06 22:42:52.195296 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1210987001 Sep 06 22:42:52.195296 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User: tempest-VolumesSnapshotsTestJSON-1210987001-project Sep 06 22:42:52.195296 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Sep 06 22:42:52.195296 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Sep 06 22:42:52.195296 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Id: a742445cb56f4e1b951e76acfc16a695 Sep 06 22:42:52.195296 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1210987001-project Sep 06 22:42:52.195296 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: method: Sep 06 22:42:52.195296 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: exception: Snapshot 05cb87f2-d07f-44de-9a32-6c816d7799e0 could not be found. Sep 06 22:42:52.195296 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: action_args: {'id': '05cb87f2-d07f-44de-9a32-6c816d7799e0'} Sep 06 22:42:52.195296 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:42:52.195940 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:42:52.195940 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 06 22:42:52.195940 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 06 22:42:52.195940 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 06 22:42:52.195940 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 06 22:42:52.195940 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 06 22:42:52.195940 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 06 22:42:52.195940 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 22:42:52.195940 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 22:42:52.195940 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 22:42:52.195940 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 22:42:52.195940 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 22:42:52.195940 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 22:42:52.195940 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 22:42:52.195940 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 22:42:52.195940 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 05cb87f2-d07f-44de-9a32-6c816d7799e0 could not be found. (HTTP 404) (Request-ID: req-3b4f5e11-64cb-4d19-8130-dfa131e7f735) Sep 06 22:42:52.195940 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:42:52.195940 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:42:52.196869 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:42:52.196869 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:42:52.196869 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 06 22:42:52.196869 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 06 22:42:52.196869 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 22:42:52.196869 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 22:42:52.196869 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 06 22:42:52.196869 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 06 22:42:52.196869 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 22:42:52.196869 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 22:42:52.196869 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 06 22:42:52.196869 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 06 22:42:52.196869 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 06 22:42:52.196869 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 06 22:42:52.196869 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 06 22:42:52.196869 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 06 22:42:52.196869 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 22:42:52.196869 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 22:42:52.196869 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 22:42:52.197860 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 22:42:52.197860 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 22:42:52.197860 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 22:42:52.197860 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 22:42:52.197860 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 22:42:52.197860 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 05cb87f2-d07f-44de-9a32-6c816d7799e0 could not be found. Sep 06 22:42:52.197860 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:42:52.197860 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:42:52.197860 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:42:52.197860 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:42:52.197860 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:42:52.197860 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:42:52.197860 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:42:52.197860 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:42:52.197860 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 22:42:52.197860 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 22:42:52.197860 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:42:52.197860 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:42:52.197860 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 06 22:42:52.197860 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:42:52.198796 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 05cb87f2-d07f-44de-9a32-6c816d7799e0 could not be found. Sep 06 22:42:52.198796 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:42:52.198796 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:42:52.198796 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:42:52.198796 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:42:52.198796 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:42:52.198796 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:42:52.198796 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:42:52.198796 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:42:52.198796 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 05cb87f2-d07f-44de-9a32-6c816d7799e0 could not be found. Sep 06 22:42:52.198796 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:42:52.204584 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-00f063f5-1eb5-4cc8-88ed-c5795c28f8d5 tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] Returning 404 to user: Snapshot 05cb87f2-d07f-44de-9a32-6c816d7799e0 could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:42:52.208050 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-00f063f5-1eb5-4cc8-88ed-c5795c28f8d5 tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/05cb87f2-d07f-44de-9a32-6c816d7799e0" status: 404 len: 111 microversion: 2.1 time: 0.074007 Sep 06 22:42:52.209003 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 10/18] 10.222.0.39 () {58 vars in 1251 bytes} [Tue Sep 6 22:42:52 2022] GET /compute/v2.1/os-snapshots/05cb87f2-d07f-44de-9a32-6c816d7799e0 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 22:42:52.224294 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-90f5639e-d18d-4fa4-8323-440d218f0063 tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] Calling method '.version_select at 0x7f9c50612040>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:42:52.422831 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-90f5639e-d18d-4fa4-8323-440d218f0063 tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/dbe2a874-7b51-40ce-9361-3d02ccd572cf" status: 202 len: 0 microversion: 2.1 time: 0.207501 Sep 06 22:42:52.425318 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 11/19] 10.222.0.39 () {58 vars in 1248 bytes} [Tue Sep 6 22:42:52 2022] DELETE /compute/v2.1/os-volumes/dbe2a874-7b51-40ce-9361-3d02ccd572cf => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 22:42:52.434826 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-5c580907-4ab5-46d0-9d76-867a9acf4596 tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] Calling method '.version_select at 0x7f9c505823a0>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:42:52.549549 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-5c580907-4ab5-46d0-9d76-867a9acf4596 tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/dbe2a874-7b51-40ce-9361-3d02ccd572cf" status: 200 len: 344 microversion: 2.1 time: 0.119742 Sep 06 22:42:52.560603 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 12/20] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Sep 6 22:42:52 2022] GET /compute/v2.1/os-volumes/dbe2a874-7b51-40ce-9361-3d02ccd572cf => generated 344 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:42:53.572749 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9fefba5b-d38b-4d76-a388-c28ac2d13f64 tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] Calling method '.version_select at 0x7f9c50509430>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:42:53.747747 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9fefba5b-d38b-4d76-a388-c28ac2d13f64 tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/dbe2a874-7b51-40ce-9361-3d02ccd572cf" status: 200 len: 344 microversion: 2.1 time: 0.182029 Sep 06 22:42:53.755956 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 13/21] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Sep 6 22:42:53 2022] GET /compute/v2.1/os-volumes/dbe2a874-7b51-40ce-9361-3d02ccd572cf => generated 344 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:42:54.294531 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-37483e23-c21d-4a12-b91a-cf66c61d8eb6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Flavor limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 22:42:54.294998 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-37483e23-c21d-4a12-b91a-cf66c61d8eb6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Image limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 22:42:54.295781 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-37483e23-c21d-4a12-b91a-cf66c61d8eb6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Flavor pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 22:42:54.296400 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-37483e23-c21d-4a12-b91a-cf66c61d8eb6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Image pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 22:42:54.297633 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-37483e23-c21d-4a12-b91a-cf66c61d8eb6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 22:42:54.337294 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-37483e23-c21d-4a12-b91a-cf66c61d8eb6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:42:54.337814 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-37483e23-c21d-4a12-b91a-cf66c61d8eb6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:42:54.341427 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-37483e23-c21d-4a12-b91a-cf66c61d8eb6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:42:54.342427 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-37483e23-c21d-4a12-b91a-cf66c61d8eb6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:42:54.342938 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-37483e23-c21d-4a12-b91a-cf66c61d8eb6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:42:54.343473 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-37483e23-c21d-4a12-b91a-cf66c61d8eb6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:42:54.447062 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-37483e23-c21d-4a12-b91a-cf66c61d8eb6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Getting quotas for project 84c39ea86193481fa08158197629ea85. Resources: {'instances', 'ram', 'cores'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 22:42:54.466429 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-37483e23-c21d-4a12-b91a-cf66c61d8eb6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Getting quotas for user 2945d87f1c114dd0b42c4e58a8133e76 and project 84c39ea86193481fa08158197629ea85. Resources: {'instances', 'ram', 'cores'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 22:42:54.483831 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-37483e23-c21d-4a12-b91a-cf66c61d8eb6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Going to run 1 instances... {{(pid=127088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 22:42:54.490187 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-37483e23-c21d-4a12-b91a-cf66c61d8eb6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 5bcd7a9d-c2c8-489c-9827-b6be1508d63c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='93326d5e-4826-431e-9ad1-6ee2d44e48d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 22:42:54.675778 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-37483e23-c21d-4a12-b91a-cf66c61d8eb6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.966273 Sep 06 22:42:54.676415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 9/22] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Sep 6 22:42:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 2968 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 22:42:54.712312 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-2c64dfdc-0d33-49bb-9947-15335adf2e66 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:42:54.713844 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-2c64dfdc-0d33-49bb-9947-15335adf2e66 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 5bcd7a9d-c2c8-489c-9827-b6be1508d63c] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:42:54.765150 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f3e1363b-d2b7-4fa4-b69e-8cd805eba5cb tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] Calling method '.version_select at 0x7f9c5050fe50>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:42:54.822366 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-f3e1363b-d2b7-4fa4-b69e-8cd805eba5cb tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] HTTP exception thrown: Volume dbe2a874-7b51-40ce-9361-3d02ccd572cf could not be found. Sep 06 22:42:54.827445 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f3e1363b-d2b7-4fa4-b69e-8cd805eba5cb tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] Request method failure captured: Sep 06 22:42:54.827445 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/os-volumes/dbe2a874-7b51-40ce-9361-3d02ccd572cf HTTP/1.1 Sep 06 22:42:54.827445 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept: application/json Sep 06 22:42:54.827445 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Sep 06 22:42:54.827445 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Connection: close Sep 06 22:42:54.827445 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Length: 0 Sep 06 22:42:54.827445 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Type: application/json Sep 06 22:42:54.827445 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Host: 10.222.0.39 Sep 06 22:42:54.827445 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Sep 06 22:42:54.827445 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Sep 06 22:42:54.827445 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjF8zd_SLnAWjB6Y08bWElzrPkzh4PmSfezlXg7UTR2C59HmKFLIheRVl2UpPDpBi3_rPYxJkIWR9xcLxgWXe8IqFySWsJ6uc30TcLxNXBvnctj2cYfF5d8TJY8BPTIRsjdHc3LR4YnyjO5cZO0g83OEkZ9FybVkC3BWeGkfSrOPa5MkE Sep 06 22:42:54.827445 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Sep 06 22:42:54.827445 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Sep 06 22:42:54.827445 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Sep 06 22:42:54.827445 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Sep 06 22:42:54.827445 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Sep 06 22:42:54.827445 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Sep 06 22:42:54.827445 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Id: 200607d5d1f8491e9168dddd9903b779 Sep 06 22:42:54.827445 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1210987001 Sep 06 22:42:54.827445 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Role: reader,member Sep 06 22:42:54.827445 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Sep 06 22:42:54.828981 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/200607d5d1f8491e9168dddd9903b779"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_200607d5d1f8491e9168dddd9903b779"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/200607d5d1f8491e9168dddd9903b779"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/200607d5d1f8491e9168dddd9903b779"}]}] Sep 06 22:42:54.828981 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1210987001 Sep 06 22:42:54.828981 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 200607d5d1f8491e9168dddd9903b779 Sep 06 22:42:54.828981 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1210987001 Sep 06 22:42:54.828981 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User: tempest-VolumesSnapshotsTestJSON-1210987001-project Sep 06 22:42:54.828981 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Sep 06 22:42:54.828981 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Sep 06 22:42:54.828981 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Id: a742445cb56f4e1b951e76acfc16a695 Sep 06 22:42:54.828981 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1210987001-project Sep 06 22:42:54.828981 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: method: Sep 06 22:42:54.828981 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: exception: Volume dbe2a874-7b51-40ce-9361-3d02ccd572cf could not be found. Sep 06 22:42:54.828981 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: action_args: {'id': 'dbe2a874-7b51-40ce-9361-3d02ccd572cf'} Sep 06 22:42:54.828981 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:42:54.830052 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:42:54.830052 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 22:42:54.830052 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 22:42:54.830052 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 22:42:54.830052 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 22:42:54.830052 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 22:42:54.830052 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 22:42:54.830052 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 22:42:54.830052 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 22:42:54.830052 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 22:42:54.830052 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 22:42:54.830052 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 22:42:54.830052 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 22:42:54.830052 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 22:42:54.830052 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 22:42:54.830052 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dbe2a874-7b51-40ce-9361-3d02ccd572cf could not be found. (HTTP 404) (Request-ID: req-d01f7940-a2ca-452e-83ea-b2d8ebae8050) Sep 06 22:42:54.830052 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:42:54.830052 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:42:54.830052 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:42:54.839602 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:42:54.839602 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 06 22:42:54.839602 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 06 22:42:54.839602 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 22:42:54.839602 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 22:42:54.839602 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 22:42:54.839602 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 22:42:54.839602 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 22:42:54.839602 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 22:42:54.839602 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 22:42:54.839602 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 22:42:54.839602 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 22:42:54.839602 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 22:42:54.839602 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 22:42:54.839602 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 22:42:54.839602 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 22:42:54.839602 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 22:42:54.839602 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 22:42:54.839602 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 22:42:54.840701 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 22:42:54.840701 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 22:42:54.840701 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 22:42:54.840701 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 22:42:54.840701 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dbe2a874-7b51-40ce-9361-3d02ccd572cf could not be found. Sep 06 22:42:54.840701 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:42:54.840701 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:42:54.840701 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:42:54.840701 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:42:54.840701 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:42:54.840701 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:42:54.840701 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:42:54.840701 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:42:54.840701 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 22:42:54.840701 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 22:42:54.840701 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:42:54.840701 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:42:54.840701 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 06 22:42:54.840701 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:42:54.841834 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dbe2a874-7b51-40ce-9361-3d02ccd572cf could not be found. Sep 06 22:42:54.841834 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:42:54.841834 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:42:54.841834 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:42:54.841834 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:42:54.841834 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:42:54.841834 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:42:54.841834 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:42:54.841834 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:42:54.841834 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dbe2a874-7b51-40ce-9361-3d02ccd572cf could not be found. Sep 06 22:42:54.841834 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:42:54.844255 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f3e1363b-d2b7-4fa4-b69e-8cd805eba5cb tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] Returning 404 to user: Volume dbe2a874-7b51-40ce-9361-3d02ccd572cf could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:42:54.845470 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f3e1363b-d2b7-4fa4-b69e-8cd805eba5cb tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/dbe2a874-7b51-40ce-9361-3d02ccd572cf" status: 404 len: 109 microversion: 2.1 time: 0.085566 Sep 06 22:42:54.848605 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 10/23] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Sep 6 22:42:54 2022] GET /compute/v2.1/os-volumes/dbe2a874-7b51-40ce-9361-3d02ccd572cf => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 22:42:54.914293 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f5a8bd9f-d3a9-4fa8-9f2f-d5bbce618a7c tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] Calling method '.version_select at 0x7f9c50f5aa60>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:42:55.013589 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-2c64dfdc-0d33-49bb-9947-15335adf2e66 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:42:55.069573 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-2c64dfdc-0d33-49bb-9947-15335adf2e66 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c" status: 200 len: 1222 microversion: 2.1 time: 0.370473 Sep 06 22:42:55.076454 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 14/24] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:42:54 2022] GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c => generated 1222 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:42:55.103608 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-f5a8bd9f-d3a9-4fa8-9f2f-d5bbce618a7c tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] HTTP exception thrown: Volume dbe2a874-7b51-40ce-9361-3d02ccd572cf could not be found. Sep 06 22:42:55.105511 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f5a8bd9f-d3a9-4fa8-9f2f-d5bbce618a7c tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] Request method failure captured: Sep 06 22:42:55.105511 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: request: DELETE /compute/v2.1/os-volumes/dbe2a874-7b51-40ce-9361-3d02ccd572cf HTTP/1.1 Sep 06 22:42:55.105511 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept: application/json Sep 06 22:42:55.105511 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Sep 06 22:42:55.105511 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Connection: close Sep 06 22:42:55.105511 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Length: 0 Sep 06 22:42:55.105511 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Type: application/json Sep 06 22:42:55.105511 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Host: 10.222.0.39 Sep 06 22:42:55.105511 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Sep 06 22:42:55.105511 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Sep 06 22:42:55.105511 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjF8zd_SLnAWjB6Y08bWElzrPkzh4PmSfezlXg7UTR2C59HmKFLIheRVl2UpPDpBi3_rPYxJkIWR9xcLxgWXe8IqFySWsJ6uc30TcLxNXBvnctj2cYfF5d8TJY8BPTIRsjdHc3LR4YnyjO5cZO0g83OEkZ9FybVkC3BWeGkfSrOPa5MkE Sep 06 22:42:55.105511 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Sep 06 22:42:55.105511 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Sep 06 22:42:55.105511 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Sep 06 22:42:55.105511 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Sep 06 22:42:55.105511 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Sep 06 22:42:55.105511 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Sep 06 22:42:55.105511 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Id: 200607d5d1f8491e9168dddd9903b779 Sep 06 22:42:55.105511 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1210987001 Sep 06 22:42:55.105511 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Role: reader,member Sep 06 22:42:55.105511 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Sep 06 22:42:55.106861 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/200607d5d1f8491e9168dddd9903b779"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_200607d5d1f8491e9168dddd9903b779"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/200607d5d1f8491e9168dddd9903b779"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/200607d5d1f8491e9168dddd9903b779"}]}] Sep 06 22:42:55.106861 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1210987001 Sep 06 22:42:55.106861 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 200607d5d1f8491e9168dddd9903b779 Sep 06 22:42:55.106861 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1210987001 Sep 06 22:42:55.106861 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User: tempest-VolumesSnapshotsTestJSON-1210987001-project Sep 06 22:42:55.106861 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Sep 06 22:42:55.106861 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Sep 06 22:42:55.106861 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Id: a742445cb56f4e1b951e76acfc16a695 Sep 06 22:42:55.106861 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1210987001-project Sep 06 22:42:55.106861 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: method: Sep 06 22:42:55.106861 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: exception: Volume dbe2a874-7b51-40ce-9361-3d02ccd572cf could not be found. Sep 06 22:42:55.106861 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: action_args: {'id': 'dbe2a874-7b51-40ce-9361-3d02ccd572cf'} Sep 06 22:42:55.106861 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:42:55.107709 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:42:55.107709 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 22:42:55.107709 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 22:42:55.107709 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 22:42:55.107709 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 22:42:55.107709 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 22:42:55.107709 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 22:42:55.107709 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 22:42:55.107709 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 22:42:55.107709 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 22:42:55.107709 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 22:42:55.107709 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 22:42:55.107709 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 22:42:55.107709 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 22:42:55.107709 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 22:42:55.107709 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dbe2a874-7b51-40ce-9361-3d02ccd572cf could not be found. (HTTP 404) (Request-ID: req-112c34af-b537-4256-adb9-1e2e00e15806) Sep 06 22:42:55.107709 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:42:55.107709 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:42:55.107709 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:42:55.109013 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:42:55.109013 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 06 22:42:55.109013 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 06 22:42:55.109013 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 22:42:55.109013 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 22:42:55.109013 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 22:42:55.109013 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 22:42:55.109013 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 22:42:55.109013 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 22:42:55.109013 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 22:42:55.109013 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 22:42:55.109013 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 22:42:55.109013 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 22:42:55.109013 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 22:42:55.109013 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 22:42:55.109013 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 22:42:55.109013 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 22:42:55.109013 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 22:42:55.109013 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 22:42:55.110263 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 22:42:55.110263 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 22:42:55.110263 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 22:42:55.110263 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 22:42:55.110263 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dbe2a874-7b51-40ce-9361-3d02ccd572cf could not be found. Sep 06 22:42:55.110263 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:42:55.110263 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:42:55.110263 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:42:55.110263 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:42:55.110263 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:42:55.110263 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:42:55.110263 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:42:55.110263 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:42:55.110263 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 22:42:55.110263 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 22:42:55.110263 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:42:55.110263 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:42:55.110263 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 06 22:42:55.110263 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:42:55.111629 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dbe2a874-7b51-40ce-9361-3d02ccd572cf could not be found. Sep 06 22:42:55.111629 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:42:55.111629 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:42:55.111629 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:42:55.111629 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:42:55.111629 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:42:55.111629 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:42:55.111629 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:42:55.111629 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:42:55.111629 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dbe2a874-7b51-40ce-9361-3d02ccd572cf could not be found. Sep 06 22:42:55.111629 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:42:55.111629 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f5a8bd9f-d3a9-4fa8-9f2f-d5bbce618a7c tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] Returning 404 to user: Volume dbe2a874-7b51-40ce-9361-3d02ccd572cf could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:42:55.111629 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f5a8bd9f-d3a9-4fa8-9f2f-d5bbce618a7c tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/dbe2a874-7b51-40ce-9361-3d02ccd572cf" status: 404 len: 109 microversion: 2.1 time: 0.237220 Sep 06 22:42:55.111629 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 11/25] 10.222.0.39 () {58 vars in 1248 bytes} [Tue Sep 6 22:42:54 2022] DELETE /compute/v2.1/os-volumes/dbe2a874-7b51-40ce-9361-3d02ccd572cf => generated 109 bytes in 248 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 22:42:55.115539 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ccb2ab61-6634-430e-8a17-c30b26fba3d0 tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] Calling method '.version_select at 0x7f9c4fc6cb80>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:42:55.394224 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-ccb2ab61-6634-430e-8a17-c30b26fba3d0 tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] HTTP exception thrown: Volume dbe2a874-7b51-40ce-9361-3d02ccd572cf could not be found. Sep 06 22:42:55.397557 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ccb2ab61-6634-430e-8a17-c30b26fba3d0 tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] Request method failure captured: Sep 06 22:42:55.397557 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/os-volumes/dbe2a874-7b51-40ce-9361-3d02ccd572cf HTTP/1.1 Sep 06 22:42:55.397557 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept: application/json Sep 06 22:42:55.397557 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Sep 06 22:42:55.397557 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Connection: close Sep 06 22:42:55.397557 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Length: 0 Sep 06 22:42:55.397557 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Type: application/json Sep 06 22:42:55.397557 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Host: 10.222.0.39 Sep 06 22:42:55.397557 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Sep 06 22:42:55.397557 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Sep 06 22:42:55.397557 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjF8zd_SLnAWjB6Y08bWElzrPkzh4PmSfezlXg7UTR2C59HmKFLIheRVl2UpPDpBi3_rPYxJkIWR9xcLxgWXe8IqFySWsJ6uc30TcLxNXBvnctj2cYfF5d8TJY8BPTIRsjdHc3LR4YnyjO5cZO0g83OEkZ9FybVkC3BWeGkfSrOPa5MkE Sep 06 22:42:55.397557 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Sep 06 22:42:55.397557 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Sep 06 22:42:55.397557 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Sep 06 22:42:55.397557 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Sep 06 22:42:55.397557 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Sep 06 22:42:55.397557 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Sep 06 22:42:55.397557 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Id: 200607d5d1f8491e9168dddd9903b779 Sep 06 22:42:55.397557 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1210987001 Sep 06 22:42:55.397557 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Role: reader,member Sep 06 22:42:55.397557 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Sep 06 22:42:55.398619 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/200607d5d1f8491e9168dddd9903b779"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_200607d5d1f8491e9168dddd9903b779"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/200607d5d1f8491e9168dddd9903b779"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/200607d5d1f8491e9168dddd9903b779"}]}] Sep 06 22:42:55.398619 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1210987001 Sep 06 22:42:55.398619 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 200607d5d1f8491e9168dddd9903b779 Sep 06 22:42:55.398619 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1210987001 Sep 06 22:42:55.398619 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User: tempest-VolumesSnapshotsTestJSON-1210987001-project Sep 06 22:42:55.398619 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Sep 06 22:42:55.398619 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Sep 06 22:42:55.398619 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Id: a742445cb56f4e1b951e76acfc16a695 Sep 06 22:42:55.398619 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1210987001-project Sep 06 22:42:55.398619 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: method: Sep 06 22:42:55.398619 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: exception: Volume dbe2a874-7b51-40ce-9361-3d02ccd572cf could not be found. Sep 06 22:42:55.398619 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: action_args: {'id': 'dbe2a874-7b51-40ce-9361-3d02ccd572cf'} Sep 06 22:42:55.398619 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:42:55.399245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:42:55.399245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 22:42:55.399245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 22:42:55.399245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 22:42:55.399245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 22:42:55.399245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 22:42:55.399245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 22:42:55.399245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 22:42:55.399245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 22:42:55.399245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 22:42:55.399245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 22:42:55.399245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 22:42:55.399245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 22:42:55.399245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 22:42:55.399245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 22:42:55.399245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dbe2a874-7b51-40ce-9361-3d02ccd572cf could not be found. (HTTP 404) (Request-ID: req-b567e95f-fc23-42eb-9e89-02baec945b41) Sep 06 22:42:55.399245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:42:55.399245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:42:55.399245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:42:55.400145 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:42:55.400145 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 06 22:42:55.400145 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 06 22:42:55.400145 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 22:42:55.400145 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 22:42:55.400145 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 22:42:55.400145 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 22:42:55.400145 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 22:42:55.400145 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 22:42:55.400145 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 22:42:55.400145 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 22:42:55.400145 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 22:42:55.400145 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 22:42:55.400145 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 22:42:55.400145 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 22:42:55.400145 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 22:42:55.400145 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 22:42:55.400145 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 22:42:55.400145 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 22:42:55.401084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 22:42:55.401084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 22:42:55.401084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 22:42:55.401084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 22:42:55.401084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dbe2a874-7b51-40ce-9361-3d02ccd572cf could not be found. Sep 06 22:42:55.401084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:42:55.401084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:42:55.401084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:42:55.401084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:42:55.401084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:42:55.401084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:42:55.401084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:42:55.401084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:42:55.401084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 22:42:55.401084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 22:42:55.401084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:42:55.401084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:42:55.401084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 06 22:42:55.401084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:42:55.401959 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dbe2a874-7b51-40ce-9361-3d02ccd572cf could not be found. Sep 06 22:42:55.401959 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:42:55.401959 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:42:55.401959 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:42:55.401959 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:42:55.401959 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:42:55.401959 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:42:55.401959 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:42:55.401959 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:42:55.401959 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dbe2a874-7b51-40ce-9361-3d02ccd572cf could not be found. Sep 06 22:42:55.401959 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:42:55.401959 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ccb2ab61-6634-430e-8a17-c30b26fba3d0 tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] Returning 404 to user: Volume dbe2a874-7b51-40ce-9361-3d02ccd572cf could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:42:55.401959 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ccb2ab61-6634-430e-8a17-c30b26fba3d0 tempest-VolumesSnapshotsTestJSON-1210987001 tempest-VolumesSnapshotsTestJSON-1210987001-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/dbe2a874-7b51-40ce-9361-3d02ccd572cf" status: 404 len: 109 microversion: 2.1 time: 0.287545 Sep 06 22:42:55.401959 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 12/26] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Sep 6 22:42:55 2022] GET /compute/v2.1/os-volumes/dbe2a874-7b51-40ce-9361-3d02ccd572cf => generated 109 bytes in 289 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 22:42:55.436132 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-499562a0-d58b-4fef-9317-f348ec574e9b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1508868751", "imageRef": "93326d5e-4826-431e-9ad1-6ee2d44e48d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:42:55.681357 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.network.neutron [None req-499562a0-d58b-4fef-9317-f348ec574e9b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] validate_networks() for [('06b475d5-934b-4826-b952-a6c0a64b3745', None, None, None, None, None)] {{(pid=127088) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 22:42:55.859850 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-0339aa54-bf27-4acb-8998-bb0e32f3c41b tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-764933990", "imageRef": "93326d5e-4826-431e-9ad1-6ee2d44e48d9", "flavorRef": "452", "networks": [{"uuid": "13f85752-5b82-45fa-b3c3-662ed0044568"}]}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:42:56.093478 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.network.neutron [None req-0339aa54-bf27-4acb-8998-bb0e32f3c41b tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] validate_networks() for [('13f85752-5b82-45fa-b3c3-662ed0044568', None, None, None, None, None)] {{(pid=127087) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 22:42:57.607428 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-499562a0-d58b-4fef-9317-f348ec574e9b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Flavor limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 22:42:57.609329 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-499562a0-d58b-4fef-9317-f348ec574e9b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Image limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 22:42:57.610519 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-499562a0-d58b-4fef-9317-f348ec574e9b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Flavor pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 22:42:57.611132 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-499562a0-d58b-4fef-9317-f348ec574e9b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Image pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 22:42:57.611859 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-499562a0-d58b-4fef-9317-f348ec574e9b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 22:42:57.628323 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-499562a0-d58b-4fef-9317-f348ec574e9b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:42:57.629210 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-499562a0-d58b-4fef-9317-f348ec574e9b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:42:57.631809 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-499562a0-d58b-4fef-9317-f348ec574e9b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:42:57.637423 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-499562a0-d58b-4fef-9317-f348ec574e9b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:42:57.642580 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-499562a0-d58b-4fef-9317-f348ec574e9b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:42:57.644436 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-499562a0-d58b-4fef-9317-f348ec574e9b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:42:57.705968 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-499562a0-d58b-4fef-9317-f348ec574e9b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Getting quotas for project 84c39ea86193481fa08158197629ea85. Resources: {'instances', 'ram', 'cores'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 22:42:57.715872 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-499562a0-d58b-4fef-9317-f348ec574e9b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Getting quotas for user 2945d87f1c114dd0b42c4e58a8133e76 and project 84c39ea86193481fa08158197629ea85. Resources: {'instances', 'ram', 'cores'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 22:42:57.744098 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-499562a0-d58b-4fef-9317-f348ec574e9b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Going to run 1 instances... {{(pid=127088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 22:42:57.752093 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-499562a0-d58b-4fef-9317-f348ec574e9b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='93326d5e-4826-431e-9ad1-6ee2d44e48d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 22:42:57.894902 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-499562a0-d58b-4fef-9317-f348ec574e9b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.490667 Sep 06 22:42:57.898352 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 13/27] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Sep 6 22:42:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 2498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 22:42:58.267649 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-cbc07703-412d-4511-b0a1-25e1680f9d31 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Action: 'create', calling method: .version_select at 0x7f9c4fc8cee0>, body: {"keypair": {"name": "tempest-keypair-1368608679", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJucZr7NHu4ddIe2Qa9vDKSNxjwvscqW949Z1wJ2i0jbZ+dtCOc7B0UrXUirMesGQ4Y3iQH7ejtTolUNL+a8mcNIxaVWpftB4e+SBZMDKqcXuLF9Iowwcq+490qbTAtsNQ=="}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:42:58.319238 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-cbc07703-412d-4511-b0a1-25e1680f9d31 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Getting quotas for project 38bf7d2d331a472c9d517f3c3067f58e. Resources: {'key_pairs'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 22:42:58.325184 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-cbc07703-412d-4511-b0a1-25e1680f9d31 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Getting quotas for user e305e7d0cbfc4aeca6164685d0155475 and project 38bf7d2d331a472c9d517f3c3067f58e. Resources: {'key_pairs'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 22:42:58.393874 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-cbc07703-412d-4511-b0a1-25e1680f9d31 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.494123 Sep 06 22:42:58.394827 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 14/28] 10.222.0.39 () {62 vars in 1200 bytes} [Tue Sep 6 22:42:57 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 496 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 06 22:42:58.403258 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0016e237-9bac-46de-bfdd-7a7e8cf94238 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:42:58.404089 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0016e237-9bac-46de-bfdd-7a7e8cf94238 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:42:58.666406 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0016e237-9bac-46de-bfdd-7a7e8cf94238 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:42:58.673642 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-0339aa54-bf27-4acb-8998-bb0e32f3c41b tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Flavor limits 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 22:42:58.674073 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-0339aa54-bf27-4acb-8998-bb0e32f3c41b tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Image limits 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 22:42:58.674666 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-0339aa54-bf27-4acb-8998-bb0e32f3c41b tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Flavor pref 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 22:42:58.675358 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-0339aa54-bf27-4acb-8998-bb0e32f3c41b tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Image pref 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 22:42:58.676035 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-0339aa54-bf27-4acb-8998-bb0e32f3c41b tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 22:42:58.702492 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0339aa54-bf27-4acb-8998-bb0e32f3c41b tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:42:58.704935 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0339aa54-bf27-4acb-8998-bb0e32f3c41b tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:42:58.705576 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0339aa54-bf27-4acb-8998-bb0e32f3c41b tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:42:58.707289 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0339aa54-bf27-4acb-8998-bb0e32f3c41b tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:42:58.709598 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0339aa54-bf27-4acb-8998-bb0e32f3c41b tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:42:58.710634 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0339aa54-bf27-4acb-8998-bb0e32f3c41b tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:42:58.713307 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0016e237-9bac-46de-bfdd-7a7e8cf94238 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1222 microversion: 2.1 time: 0.316435 Sep 06 22:42:58.714514 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 15/29] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:42:58 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1222 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:42:58.776063 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-0339aa54-bf27-4acb-8998-bb0e32f3c41b tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Getting quotas for project 2f01bb55623a4bf580008b75a9715796. Resources: {'instances', 'ram', 'cores'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 22:42:58.787533 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-0339aa54-bf27-4acb-8998-bb0e32f3c41b tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Getting quotas for user da5264060ddd48afa8305c38a9bfa4c3 and project 2f01bb55623a4bf580008b75a9715796. Resources: {'instances', 'ram', 'cores'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 22:42:58.819385 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-0339aa54-bf27-4acb-8998-bb0e32f3c41b tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Going to run 1 instances... {{(pid=127087) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 22:42:58.822192 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-0339aa54-bf27-4acb-8998-bb0e32f3c41b tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='93326d5e-4826-431e-9ad1-6ee2d44e48d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 22:42:58.997584 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-0339aa54-bf27-4acb-8998-bb0e32f3c41b tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.902572 Sep 06 22:42:59.005454 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 15/30] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Sep 6 22:42:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 22:42:59.013068 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ee01de4e-4710-4b86-a0ee-b9306c712bae tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:42:59.014091 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ee01de4e-4710-4b86-a0ee-b9306c712bae tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:42:59.223775 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ee01de4e-4710-4b86-a0ee-b9306c712bae tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5264060ddd48afa8305c38a9bfa4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f01bb55623a4bf580008b75a9715796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:42:59.236305 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ee01de4e-4710-4b86-a0ee-b9306c712bae tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291" status: 200 len: 1214 microversion: 2.1 time: 0.226538 Sep 06 22:42:59.239027 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 16/31] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:42:59 2022] GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 => generated 1214 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:42:59.365768 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6cdfaead-a672-435c-9e4a-65e507a45481 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1875530838", "imageRef": "93326d5e-4826-431e-9ad1-6ee2d44e48d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dca78c2a-dc31-4fa0-b0e0-5bcdd9a87416"}], "security_groups": [{"name": "tempest-securitygroup--110719981"}], "key_name": "tempest-keypair-1014378103", "user_data": "}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:42:59.633720 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.network.neutron [None req-6cdfaead-a672-435c-9e4a-65e507a45481 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] validate_networks() for [('dca78c2a-dc31-4fa0-b0e0-5bcdd9a87416', None, None, None, None, None)] {{(pid=127087) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 22:42:59.742542 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6fddbf7b-9dd6-4875-aee3-df3394f0970d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:42:59.744481 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6fddbf7b-9dd6-4875-aee3-df3394f0970d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:42:59.765630 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6fddbf7b-9dd6-4875-aee3-df3394f0970d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:42:59.770726 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6fddbf7b-9dd6-4875-aee3-df3394f0970d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:42:59.772852 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6fddbf7b-9dd6-4875-aee3-df3394f0970d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:42:59.777210 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6fddbf7b-9dd6-4875-aee3-df3394f0970d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:42:59.782687 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6fddbf7b-9dd6-4875-aee3-df3394f0970d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:42:59.785453 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6fddbf7b-9dd6-4875-aee3-df3394f0970d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:00.517589 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6fddbf7b-9dd6-4875-aee3-df3394f0970d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:00.543274 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6fddbf7b-9dd6-4875-aee3-df3394f0970d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1226 microversion: 2.1 time: 0.805489 Sep 06 22:43:00.543888 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 17/32] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:42:59 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1226 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:43:00.575233 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3c03287d-1b91-46bc-9001-5e3c6cbb6dd7 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:00.576620 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3c03287d-1b91-46bc-9001-5e3c6cbb6dd7 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:00.597161 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3c03287d-1b91-46bc-9001-5e3c6cbb6dd7 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:00.598786 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3c03287d-1b91-46bc-9001-5e3c6cbb6dd7 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:00.599846 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3c03287d-1b91-46bc-9001-5e3c6cbb6dd7 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:00.606148 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3c03287d-1b91-46bc-9001-5e3c6cbb6dd7 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:00.607326 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3c03287d-1b91-46bc-9001-5e3c6cbb6dd7 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:00.610690 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3c03287d-1b91-46bc-9001-5e3c6cbb6dd7 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:00.815315 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-6cdfaead-a672-435c-9e4a-65e507a45481 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Flavor limits 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 22:43:00.816601 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-6cdfaead-a672-435c-9e4a-65e507a45481 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Image limits 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 22:43:00.817290 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-6cdfaead-a672-435c-9e4a-65e507a45481 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Flavor pref 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 22:43:00.817927 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-6cdfaead-a672-435c-9e4a-65e507a45481 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Image pref 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 22:43:00.818803 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-6cdfaead-a672-435c-9e4a-65e507a45481 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 22:43:00.840617 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6cdfaead-a672-435c-9e4a-65e507a45481 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:00.841304 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6cdfaead-a672-435c-9e4a-65e507a45481 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:00.841833 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6cdfaead-a672-435c-9e4a-65e507a45481 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:00.843442 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6cdfaead-a672-435c-9e4a-65e507a45481 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:00.845602 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6cdfaead-a672-435c-9e4a-65e507a45481 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:00.846290 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6cdfaead-a672-435c-9e4a-65e507a45481 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:00.882229 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3c03287d-1b91-46bc-9001-5e3c6cbb6dd7 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5264060ddd48afa8305c38a9bfa4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f01bb55623a4bf580008b75a9715796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:00.888173 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-6cdfaead-a672-435c-9e4a-65e507a45481 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Getting quotas for project 817010ab38864d8aafb61140eb176da1. Resources: {'instances', 'ram', 'cores'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 22:43:00.894114 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-6cdfaead-a672-435c-9e4a-65e507a45481 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Getting quotas for user 4dd9f0bff3044d7db561dff21ac0e7ff and project 817010ab38864d8aafb61140eb176da1. Resources: {'instances', 'ram', 'cores'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 22:43:00.895368 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3c03287d-1b91-46bc-9001-5e3c6cbb6dd7 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291" status: 200 len: 1218 microversion: 2.1 time: 0.350398 Sep 06 22:43:00.895969 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 18/33] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:00 2022] GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 => generated 1218 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:00.907281 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-6cdfaead-a672-435c-9e4a-65e507a45481 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Going to run 1 instances... {{(pid=127087) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 22:43:00.931330 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-6cdfaead-a672-435c-9e4a-65e507a45481 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='93326d5e-4826-431e-9ad1-6ee2d44e48d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 22:43:01.077223 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-6cdfaead-a672-435c-9e4a-65e507a45481 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.714543 Sep 06 22:43:01.081348 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 16/34] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Sep 6 22:42:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 1722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 22:43:01.092691 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c0924b98-6b47-429c-905a-889d079ee9b0 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:01.097406 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c0924b98-6b47-429c-905a-889d079ee9b0 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:01.252731 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c0924b98-6b47-429c-905a-889d079ee9b0 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:01.261682 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c0924b98-6b47-429c-905a-889d079ee9b0 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1238 microversion: 2.1 time: 0.174502 Sep 06 22:43:01.262294 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 19/35] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:01 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1238 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:01.571406 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-324ea0ba-f1c7-45cd-96ca-8c4a996b31af tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:01.572322 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-324ea0ba-f1c7-45cd-96ca-8c4a996b31af tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:01.589637 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-324ea0ba-f1c7-45cd-96ca-8c4a996b31af tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:01.590142 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-324ea0ba-f1c7-45cd-96ca-8c4a996b31af tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:01.594037 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-324ea0ba-f1c7-45cd-96ca-8c4a996b31af tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:01.598523 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-324ea0ba-f1c7-45cd-96ca-8c4a996b31af tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:01.599018 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-324ea0ba-f1c7-45cd-96ca-8c4a996b31af tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:01.599459 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-324ea0ba-f1c7-45cd-96ca-8c4a996b31af tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:01.915889 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ef5ad651-eba3-4db2-a7dd-8ce381e55504 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-332139850", "imageRef": "93326d5e-4826-431e-9ad1-6ee2d44e48d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "54ce4610-272a-4a71-a77c-bd38eccb62b7"}], "security_groups": [{"name": "tempest-securitygroup--1148931145"}], "key_name": "tempest-keypair-1368608679", "user_data": "}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:43:02.036951 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-324ea0ba-f1c7-45cd-96ca-8c4a996b31af tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:02.069099 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-324ea0ba-f1c7-45cd-96ca-8c4a996b31af tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1218 microversion: 2.1 time: 0.506095 Sep 06 22:43:02.069778 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 17/36] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:01 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1218 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:02.091047 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-8d77f7e2-e8a6-4c2b-b120-3b48089263c9 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:02.094370 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-8d77f7e2-e8a6-4c2b-b120-3b48089263c9 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:02.118091 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8d77f7e2-e8a6-4c2b-b120-3b48089263c9 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:02.118934 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8d77f7e2-e8a6-4c2b-b120-3b48089263c9 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:02.120372 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8d77f7e2-e8a6-4c2b-b120-3b48089263c9 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:02.121619 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8d77f7e2-e8a6-4c2b-b120-3b48089263c9 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:02.123413 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8d77f7e2-e8a6-4c2b-b120-3b48089263c9 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:02.127903 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8d77f7e2-e8a6-4c2b-b120-3b48089263c9 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:02.202704 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.network.neutron [None req-ef5ad651-eba3-4db2-a7dd-8ce381e55504 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] validate_networks() for [('54ce4610-272a-4a71-a77c-bd38eccb62b7', None, None, None, None, None)] {{(pid=127088) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 22:43:02.433388 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-8d77f7e2-e8a6-4c2b-b120-3b48089263c9 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5264060ddd48afa8305c38a9bfa4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f01bb55623a4bf580008b75a9715796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:02.447052 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-8d77f7e2-e8a6-4c2b-b120-3b48089263c9 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291" status: 200 len: 1266 microversion: 2.1 time: 0.374636 Sep 06 22:43:02.449268 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 18/37] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:02 2022] GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 => generated 1266 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:02.463117 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-5793a342-b1ed-416b-8201-d4ae04cf4e0b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:02.464919 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-5793a342-b1ed-416b-8201-d4ae04cf4e0b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:02.481029 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5793a342-b1ed-416b-8201-d4ae04cf4e0b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:02.483105 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5793a342-b1ed-416b-8201-d4ae04cf4e0b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:02.485079 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5793a342-b1ed-416b-8201-d4ae04cf4e0b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:02.489276 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5793a342-b1ed-416b-8201-d4ae04cf4e0b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:02.491295 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5793a342-b1ed-416b-8201-d4ae04cf4e0b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:02.491999 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5793a342-b1ed-416b-8201-d4ae04cf4e0b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:02.914918 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-5793a342-b1ed-416b-8201-d4ae04cf4e0b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:02.933109 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-5793a342-b1ed-416b-8201-d4ae04cf4e0b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1242 microversion: 2.1 time: 0.481288 Sep 06 22:43:02.945079 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 19/38] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:02 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1242 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:03.092509 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f3c37333-b576-44b8-a704-4f6f3dd05f99 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:03.093322 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-f3c37333-b576-44b8-a704-4f6f3dd05f99 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:03.102282 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f3c37333-b576-44b8-a704-4f6f3dd05f99 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:03.107898 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f3c37333-b576-44b8-a704-4f6f3dd05f99 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:03.109472 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f3c37333-b576-44b8-a704-4f6f3dd05f99 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:03.111975 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f3c37333-b576-44b8-a704-4f6f3dd05f99 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:03.112668 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f3c37333-b576-44b8-a704-4f6f3dd05f99 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:03.115964 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f3c37333-b576-44b8-a704-4f6f3dd05f99 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:03.420997 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-f3c37333-b576-44b8-a704-4f6f3dd05f99 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:03.438607 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-f3c37333-b576-44b8-a704-4f6f3dd05f99 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1274 microversion: 2.1 time: 0.348790 Sep 06 22:43:03.441332 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 20/39] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:03 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1274 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:03.475714 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a36b48e6-a44a-412b-8325-0ee61f339bdd tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:03.476363 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-a36b48e6-a44a-412b-8325-0ee61f339bdd tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:03.488282 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a36b48e6-a44a-412b-8325-0ee61f339bdd tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:03.489026 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a36b48e6-a44a-412b-8325-0ee61f339bdd tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:03.490809 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a36b48e6-a44a-412b-8325-0ee61f339bdd tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:03.491706 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a36b48e6-a44a-412b-8325-0ee61f339bdd tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:03.496190 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a36b48e6-a44a-412b-8325-0ee61f339bdd tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:03.496860 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a36b48e6-a44a-412b-8325-0ee61f339bdd tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:03.679644 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-a36b48e6-a44a-412b-8325-0ee61f339bdd tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5264060ddd48afa8305c38a9bfa4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f01bb55623a4bf580008b75a9715796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:03.693618 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-a36b48e6-a44a-412b-8325-0ee61f339bdd tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291" status: 200 len: 1272 microversion: 2.1 time: 0.222336 Sep 06 22:43:03.696566 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 21/40] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:03 2022] GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 => generated 1272 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:43:03.961845 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-53de1899-fc28-4aa0-9912-a094a9b2df18 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:03.967979 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-53de1899-fc28-4aa0-9912-a094a9b2df18 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:04.019670 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-53de1899-fc28-4aa0-9912-a094a9b2df18 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:04.027443 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-53de1899-fc28-4aa0-9912-a094a9b2df18 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:04.028001 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-53de1899-fc28-4aa0-9912-a094a9b2df18 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:04.034397 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-53de1899-fc28-4aa0-9912-a094a9b2df18 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:04.041572 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-53de1899-fc28-4aa0-9912-a094a9b2df18 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:04.042222 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-53de1899-fc28-4aa0-9912-a094a9b2df18 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:05.431937 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-53de1899-fc28-4aa0-9912-a094a9b2df18 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:05.444887 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-53de1899-fc28-4aa0-9912-a094a9b2df18 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1290 microversion: 2.1 time: 1.488424 Sep 06 22:43:05.445991 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 22/41] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:03 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1290 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:43:05.465333 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9af24b65-78c2-4c75-b3ea-5828d4241a7e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:05.467383 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9af24b65-78c2-4c75-b3ea-5828d4241a7e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:05.487830 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9af24b65-78c2-4c75-b3ea-5828d4241a7e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:05.489803 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9af24b65-78c2-4c75-b3ea-5828d4241a7e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:05.490255 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9af24b65-78c2-4c75-b3ea-5828d4241a7e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:05.496356 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9af24b65-78c2-4c75-b3ea-5828d4241a7e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:05.497232 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9af24b65-78c2-4c75-b3ea-5828d4241a7e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:05.498425 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9af24b65-78c2-4c75-b3ea-5828d4241a7e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:05.695973 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9af24b65-78c2-4c75-b3ea-5828d4241a7e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:05.706904 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9af24b65-78c2-4c75-b3ea-5828d4241a7e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1280 microversion: 2.1 time: 0.257338 Sep 06 22:43:05.711424 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 23/42] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:05 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1280 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:05.721132 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-532ee1fc-c4a5-4902-ab62-5ed30635e8b7 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:05.724404 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-532ee1fc-c4a5-4902-ab62-5ed30635e8b7 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:05.731597 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-532ee1fc-c4a5-4902-ab62-5ed30635e8b7 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:05.732202 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-532ee1fc-c4a5-4902-ab62-5ed30635e8b7 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:05.733824 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-532ee1fc-c4a5-4902-ab62-5ed30635e8b7 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:05.735314 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-532ee1fc-c4a5-4902-ab62-5ed30635e8b7 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:05.735957 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-532ee1fc-c4a5-4902-ab62-5ed30635e8b7 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:05.736943 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-532ee1fc-c4a5-4902-ab62-5ed30635e8b7 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:05.824263 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-ef5ad651-eba3-4db2-a7dd-8ce381e55504 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Flavor limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 22:43:05.824893 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-ef5ad651-eba3-4db2-a7dd-8ce381e55504 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Image limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 22:43:05.825172 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-ef5ad651-eba3-4db2-a7dd-8ce381e55504 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Flavor pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 22:43:05.825858 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-ef5ad651-eba3-4db2-a7dd-8ce381e55504 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Image pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 22:43:05.826270 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-ef5ad651-eba3-4db2-a7dd-8ce381e55504 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 22:43:05.851875 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ef5ad651-eba3-4db2-a7dd-8ce381e55504 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:05.852398 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ef5ad651-eba3-4db2-a7dd-8ce381e55504 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:05.852911 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ef5ad651-eba3-4db2-a7dd-8ce381e55504 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:05.853870 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ef5ad651-eba3-4db2-a7dd-8ce381e55504 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:05.854382 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ef5ad651-eba3-4db2-a7dd-8ce381e55504 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:05.854686 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ef5ad651-eba3-4db2-a7dd-8ce381e55504 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:05.920346 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-ef5ad651-eba3-4db2-a7dd-8ce381e55504 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Getting quotas for project 38bf7d2d331a472c9d517f3c3067f58e. Resources: {'instances', 'ram', 'cores'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 22:43:05.931262 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-ef5ad651-eba3-4db2-a7dd-8ce381e55504 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Getting quotas for user e305e7d0cbfc4aeca6164685d0155475 and project 38bf7d2d331a472c9d517f3c3067f58e. Resources: {'instances', 'ram', 'cores'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 22:43:05.969156 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ef5ad651-eba3-4db2-a7dd-8ce381e55504 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Going to run 1 instances... {{(pid=127088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 22:43:05.971437 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ef5ad651-eba3-4db2-a7dd-8ce381e55504 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='93326d5e-4826-431e-9ad1-6ee2d44e48d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 22:43:06.019008 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-532ee1fc-c4a5-4902-ab62-5ed30635e8b7 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5264060ddd48afa8305c38a9bfa4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f01bb55623a4bf580008b75a9715796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:06.035050 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-532ee1fc-c4a5-4902-ab62-5ed30635e8b7 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291" status: 200 len: 1272 microversion: 2.1 time: 0.322026 Sep 06 22:43:06.038892 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 24/43] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:05 2022] GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 => generated 1272 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:06.158871 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ef5ad651-eba3-4db2-a7dd-8ce381e55504 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.242566 Sep 06 22:43:06.161159 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 20/44] 10.222.0.39 () {62 vars in 1188 bytes} [Tue Sep 6 22:43:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 4251 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 06 22:43:06.173250 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-0477329f-2e66-4e58-a73f-7cb67fc1dba9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:06.173774 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-0477329f-2e66-4e58-a73f-7cb67fc1dba9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:06.477580 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6b7db49e-323e-4a08-8465-aef028ba5bba tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:06.478542 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6b7db49e-323e-4a08-8465-aef028ba5bba tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:06.492169 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6b7db49e-323e-4a08-8465-aef028ba5bba tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:06.494808 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6b7db49e-323e-4a08-8465-aef028ba5bba tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:06.495480 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6b7db49e-323e-4a08-8465-aef028ba5bba tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:06.497961 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6b7db49e-323e-4a08-8465-aef028ba5bba tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:06.498580 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6b7db49e-323e-4a08-8465-aef028ba5bba tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:06.499163 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6b7db49e-323e-4a08-8465-aef028ba5bba tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:07.007378 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6b7db49e-323e-4a08-8465-aef028ba5bba tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:07.021819 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6b7db49e-323e-4a08-8465-aef028ba5bba tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1296 microversion: 2.1 time: 0.548779 Sep 06 22:43:07.023634 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 21/45] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:06 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1296 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:07.049312 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-05781cba-eaa6-4923-8b3c-03bd43b90d09 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:07.050226 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-05781cba-eaa6-4923-8b3c-03bd43b90d09 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:07.058032 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-05781cba-eaa6-4923-8b3c-03bd43b90d09 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:07.058693 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-05781cba-eaa6-4923-8b3c-03bd43b90d09 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:07.059334 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-05781cba-eaa6-4923-8b3c-03bd43b90d09 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:07.060188 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-05781cba-eaa6-4923-8b3c-03bd43b90d09 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:07.060811 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-05781cba-eaa6-4923-8b3c-03bd43b90d09 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:07.061449 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-05781cba-eaa6-4923-8b3c-03bd43b90d09 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:07.084053 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-0477329f-2e66-4e58-a73f-7cb67fc1dba9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:07.094652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-0477329f-2e66-4e58-a73f-7cb67fc1dba9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:07.096553 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-0477329f-2e66-4e58-a73f-7cb67fc1dba9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:07.105661 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-0477329f-2e66-4e58-a73f-7cb67fc1dba9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1281 microversion: 2.20 time: 0.936673 Sep 06 22:43:07.109000 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 25/46] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:43:06 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1281 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:43:07.121110 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a4ba3429-5029-4ea2-9472-fb3ddff76300 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:07.121791 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-a4ba3429-5029-4ea2-9472-fb3ddff76300 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:07.132334 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a4ba3429-5029-4ea2-9472-fb3ddff76300 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:07.139540 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a4ba3429-5029-4ea2-9472-fb3ddff76300 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:07.141157 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a4ba3429-5029-4ea2-9472-fb3ddff76300 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:07.142154 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a4ba3429-5029-4ea2-9472-fb3ddff76300 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:07.142789 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a4ba3429-5029-4ea2-9472-fb3ddff76300 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:07.143648 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a4ba3429-5029-4ea2-9472-fb3ddff76300 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:07.489104 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-05781cba-eaa6-4923-8b3c-03bd43b90d09 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:07.499617 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-05781cba-eaa6-4923-8b3c-03bd43b90d09 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1280 microversion: 2.1 time: 0.474891 Sep 06 22:43:07.505977 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 22/47] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:07 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1280 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:07.998741 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-a4ba3429-5029-4ea2-9472-fb3ddff76300 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5264060ddd48afa8305c38a9bfa4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f01bb55623a4bf580008b75a9715796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:08.010059 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-a4ba3429-5029-4ea2-9472-fb3ddff76300 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291" status: 200 len: 1314 microversion: 2.1 time: 0.899390 Sep 06 22:43:08.013393 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 26/48] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:07 2022] GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 => generated 1314 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:08.047675 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fd6eeb4d-f971-4f06-a15d-1b804a277595 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:08.048384 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fd6eeb4d-f971-4f06-a15d-1b804a277595 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:08.072069 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fd6eeb4d-f971-4f06-a15d-1b804a277595 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:08.072731 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fd6eeb4d-f971-4f06-a15d-1b804a277595 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:08.073284 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fd6eeb4d-f971-4f06-a15d-1b804a277595 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:08.074122 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fd6eeb4d-f971-4f06-a15d-1b804a277595 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:08.074667 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fd6eeb4d-f971-4f06-a15d-1b804a277595 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:08.075183 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fd6eeb4d-f971-4f06-a15d-1b804a277595 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:08.136116 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d34c0f75-0b0c-45e5-95ce-40b142bbb87d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:08.137466 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-d34c0f75-0b0c-45e5-95ce-40b142bbb87d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:08.156953 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d34c0f75-0b0c-45e5-95ce-40b142bbb87d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:08.160587 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d34c0f75-0b0c-45e5-95ce-40b142bbb87d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:08.162776 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d34c0f75-0b0c-45e5-95ce-40b142bbb87d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:08.165441 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d34c0f75-0b0c-45e5-95ce-40b142bbb87d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:08.167552 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d34c0f75-0b0c-45e5-95ce-40b142bbb87d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:08.173499 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d34c0f75-0b0c-45e5-95ce-40b142bbb87d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:08.355216 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fd6eeb4d-f971-4f06-a15d-1b804a277595 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:08.369309 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-d34c0f75-0b0c-45e5-95ce-40b142bbb87d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:08.380956 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fd6eeb4d-f971-4f06-a15d-1b804a277595 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1296 microversion: 2.1 time: 0.329960 Sep 06 22:43:08.383485 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 23/49] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:08 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1296 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:08.389338 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-d34c0f75-0b0c-45e5-95ce-40b142bbb87d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:08.392979 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-d34c0f75-0b0c-45e5-95ce-40b142bbb87d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:08.406857 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d34c0f75-0b0c-45e5-95ce-40b142bbb87d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1285 microversion: 2.20 time: 0.275196 Sep 06 22:43:08.408512 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 27/50] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:43:08 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1285 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:43:08.546550 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ca6cec4a-40d6-41f4-93f1-59dc66236813 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:08.553817 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ca6cec4a-40d6-41f4-93f1-59dc66236813 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:08.581765 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ca6cec4a-40d6-41f4-93f1-59dc66236813 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:08.582591 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ca6cec4a-40d6-41f4-93f1-59dc66236813 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:08.583811 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ca6cec4a-40d6-41f4-93f1-59dc66236813 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:08.584800 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ca6cec4a-40d6-41f4-93f1-59dc66236813 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:08.585906 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ca6cec4a-40d6-41f4-93f1-59dc66236813 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:08.586468 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ca6cec4a-40d6-41f4-93f1-59dc66236813 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:08.700996 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ca6cec4a-40d6-41f4-93f1-59dc66236813 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:08.709159 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ca6cec4a-40d6-41f4-93f1-59dc66236813 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1280 microversion: 2.1 time: 0.182597 Sep 06 22:43:08.710402 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 24/51] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:08 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1280 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:09.042356 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-60a780cc-1000-4c77-b9fb-888da67c9842 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:09.042967 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-60a780cc-1000-4c77-b9fb-888da67c9842 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:09.063208 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-60a780cc-1000-4c77-b9fb-888da67c9842 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:09.069649 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-60a780cc-1000-4c77-b9fb-888da67c9842 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:09.070103 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-60a780cc-1000-4c77-b9fb-888da67c9842 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:09.070930 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-60a780cc-1000-4c77-b9fb-888da67c9842 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:09.071381 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-60a780cc-1000-4c77-b9fb-888da67c9842 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:09.071798 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-60a780cc-1000-4c77-b9fb-888da67c9842 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:09.412247 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-67a16e2a-4d6e-4da6-834d-a2d1c48ee1b4 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:09.412848 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-67a16e2a-4d6e-4da6-834d-a2d1c48ee1b4 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:09.425271 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-67a16e2a-4d6e-4da6-834d-a2d1c48ee1b4 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:09.426028 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-67a16e2a-4d6e-4da6-834d-a2d1c48ee1b4 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:09.426611 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-67a16e2a-4d6e-4da6-834d-a2d1c48ee1b4 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:09.427473 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-67a16e2a-4d6e-4da6-834d-a2d1c48ee1b4 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:09.428067 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-67a16e2a-4d6e-4da6-834d-a2d1c48ee1b4 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:09.428659 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-67a16e2a-4d6e-4da6-834d-a2d1c48ee1b4 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:10.802515 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-60a780cc-1000-4c77-b9fb-888da67c9842 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5264060ddd48afa8305c38a9bfa4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f01bb55623a4bf580008b75a9715796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:10.834979 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-60a780cc-1000-4c77-b9fb-888da67c9842 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291" status: 200 len: 1314 microversion: 2.1 time: 1.796594 Sep 06 22:43:10.840557 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 28/52] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:09 2022] GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 => generated 1314 bytes in 1803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:10.860566 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9e3c1874-b7c2-4b99-aeab-65101558d40c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:10.861464 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9e3c1874-b7c2-4b99-aeab-65101558d40c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:10.872838 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=4 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:43:10.927878 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9e3c1874-b7c2-4b99-aeab-65101558d40c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:10.929808 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9e3c1874-b7c2-4b99-aeab-65101558d40c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:10.933053 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9e3c1874-b7c2-4b99-aeab-65101558d40c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:10.934536 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9e3c1874-b7c2-4b99-aeab-65101558d40c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:10.941483 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9e3c1874-b7c2-4b99-aeab-65101558d40c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:10.942985 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9e3c1874-b7c2-4b99-aeab-65101558d40c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:11.499839 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-67a16e2a-4d6e-4da6-834d-a2d1c48ee1b4 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:11.513655 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-67a16e2a-4d6e-4da6-834d-a2d1c48ee1b4 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1363 microversion: 2.1 time: 2.105143 Sep 06 22:43:11.530095 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 25/53] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:09 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1363 bytes in 2122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:11.547246 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e6ab173b-dc87-4e34-9240-b1eceb59e754 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:11.556458 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e6ab173b-dc87-4e34-9240-b1eceb59e754 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:11.568185 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e6ab173b-dc87-4e34-9240-b1eceb59e754 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:11.568185 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e6ab173b-dc87-4e34-9240-b1eceb59e754 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:11.568185 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e6ab173b-dc87-4e34-9240-b1eceb59e754 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:11.568185 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e6ab173b-dc87-4e34-9240-b1eceb59e754 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:11.568519 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e6ab173b-dc87-4e34-9240-b1eceb59e754 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:11.568519 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e6ab173b-dc87-4e34-9240-b1eceb59e754 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:11.675148 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9e3c1874-b7c2-4b99-aeab-65101558d40c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:11.690690 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9e3c1874-b7c2-4b99-aeab-65101558d40c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:11.692790 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9e3c1874-b7c2-4b99-aeab-65101558d40c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:11.694445 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9e3c1874-b7c2-4b99-aeab-65101558d40c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1341 microversion: 2.20 time: 0.851392 Sep 06 22:43:11.695702 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 29/54] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:43:10 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1341 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:43:11.808541 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-8585d5a4-6a81-407d-9adc-0140982af768 req-e5dffdea-220d-45f1-9598-d84005839024 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bcd7a9d-c2c8-489c-9827-b6be1508d63c", "tag": "20bc1f9d-50d4-4f0b-afe1-3cdbc5f69caa"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:43:11.851681 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-8585d5a4-6a81-407d-9adc-0140982af768 req-e5dffdea-220d-45f1-9598-d84005839024 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:11.852289 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-8585d5a4-6a81-407d-9adc-0140982af768 req-e5dffdea-220d-45f1-9598-d84005839024 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:11.858511 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-8585d5a4-6a81-407d-9adc-0140982af768 req-e5dffdea-220d-45f1-9598-d84005839024 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:11.927102 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-8585d5a4-6a81-407d-9adc-0140982af768 req-e5dffdea-220d-45f1-9598-d84005839024 service nova] Creating event network-changed:20bc1f9d-50d4-4f0b-afe1-3cdbc5f69caa for instance 5bcd7a9d-c2c8-489c-9827-b6be1508d63c on hv-cinder-85220 Sep 06 22:43:11.935550 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-8585d5a4-6a81-407d-9adc-0140982af768 req-e5dffdea-220d-45f1-9598-d84005839024 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127087) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 06 22:43:11.936174 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-8585d5a4-6a81-407d-9adc-0140982af768 req-e5dffdea-220d-45f1-9598-d84005839024 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127087) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 06 22:43:11.937490 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-174b5c55-3e6f-4ba3-80be-c82577be8cb5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:11.938286 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-174b5c55-3e6f-4ba3-80be-c82577be8cb5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:11.938816 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-174b5c55-3e6f-4ba3-80be-c82577be8cb5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:11.939644 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-174b5c55-3e6f-4ba3-80be-c82577be8cb5 None None] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:11.941522 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-174b5c55-3e6f-4ba3-80be-c82577be8cb5 None None] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:11.943532 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-174b5c55-3e6f-4ba3-80be-c82577be8cb5 None None] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:11.972925 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.compute.rpcapi [None req-174b5c55-3e6f-4ba3-80be-c82577be8cb5 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 06 22:43:11.973919 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-174b5c55-3e6f-4ba3-80be-c82577be8cb5 None None] Releasing lock "compute-rpcapi-router" {{(pid=127087) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 06 22:43:12.002855 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-174b5c55-3e6f-4ba3-80be-c82577be8cb5 None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.305463 Sep 06 22:43:12.003948 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 30/55] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:43:12.011700 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-204b7b11-c9cc-43b9-aaf0-ece28a81cbd8 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:12.018184 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-204b7b11-c9cc-43b9-aaf0-ece28a81cbd8 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:12.028221 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-204b7b11-c9cc-43b9-aaf0-ece28a81cbd8 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:12.029404 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-204b7b11-c9cc-43b9-aaf0-ece28a81cbd8 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:12.030494 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-204b7b11-c9cc-43b9-aaf0-ece28a81cbd8 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:12.031621 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-204b7b11-c9cc-43b9-aaf0-ece28a81cbd8 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:12.032493 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-204b7b11-c9cc-43b9-aaf0-ece28a81cbd8 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:12.034592 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-204b7b11-c9cc-43b9-aaf0-ece28a81cbd8 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:12.682217 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e6ab173b-dc87-4e34-9240-b1eceb59e754 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:12.695868 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e6ab173b-dc87-4e34-9240-b1eceb59e754 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1322 microversion: 2.1 time: 1.164341 Sep 06 22:43:12.700864 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 26/56] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:11 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1322 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:12.705945 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e4df3fa6-a83b-42d9-b04a-98d7982cf274 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:12.706997 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e4df3fa6-a83b-42d9-b04a-98d7982cf274 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:12.716537 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e4df3fa6-a83b-42d9-b04a-98d7982cf274 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:12.717202 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e4df3fa6-a83b-42d9-b04a-98d7982cf274 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:12.717836 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e4df3fa6-a83b-42d9-b04a-98d7982cf274 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:12.718835 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e4df3fa6-a83b-42d9-b04a-98d7982cf274 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:12.719504 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e4df3fa6-a83b-42d9-b04a-98d7982cf274 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:12.720172 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e4df3fa6-a83b-42d9-b04a-98d7982cf274 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:12.866681 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-204b7b11-c9cc-43b9-aaf0-ece28a81cbd8 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5264060ddd48afa8305c38a9bfa4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f01bb55623a4bf580008b75a9715796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:12.874518 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-204b7b11-c9cc-43b9-aaf0-ece28a81cbd8 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291" status: 200 len: 1314 microversion: 2.1 time: 0.868912 Sep 06 22:43:12.875802 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 31/57] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:12 2022] GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 => generated 1314 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:12.893206 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6a452d6a-f422-4261-bcc2-62317a77d602 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:12.894008 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-6a452d6a-f422-4261-bcc2-62317a77d602 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:12.900966 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6a452d6a-f422-4261-bcc2-62317a77d602 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:12.901408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6a452d6a-f422-4261-bcc2-62317a77d602 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:12.901753 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6a452d6a-f422-4261-bcc2-62317a77d602 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:12.902437 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6a452d6a-f422-4261-bcc2-62317a77d602 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:12.902877 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6a452d6a-f422-4261-bcc2-62317a77d602 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:12.903332 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6a452d6a-f422-4261-bcc2-62317a77d602 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:13.011606 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6a452d6a-f422-4261-bcc2-62317a77d602 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:13.022790 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6a452d6a-f422-4261-bcc2-62317a77d602 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:13.024318 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6a452d6a-f422-4261-bcc2-62317a77d602 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:13.025634 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-6a452d6a-f422-4261-bcc2-62317a77d602 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1339 microversion: 2.20 time: 0.148709 Sep 06 22:43:13.026575 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 32/58] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:43:12 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1339 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:43:13.058132 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e4df3fa6-a83b-42d9-b04a-98d7982cf274 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:13.071850 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e4df3fa6-a83b-42d9-b04a-98d7982cf274 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1363 microversion: 2.1 time: 0.371625 Sep 06 22:43:13.072721 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 27/59] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:12 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1363 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:13.441254 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-38fd42aa-49e0-4bdd-b8cc-2dc75c6fd94a req-a516536e-367d-4490-9bb7-32340a09c4e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4694c0a1-7900-4032-9200-acd16f179291", "tag": "cc85e0fe-203e-42a2-8387-fa852cacaca4"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:43:13.451415 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-38fd42aa-49e0-4bdd-b8cc-2dc75c6fd94a req-a516536e-367d-4490-9bb7-32340a09c4e7 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:13.452137 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-38fd42aa-49e0-4bdd-b8cc-2dc75c6fd94a req-a516536e-367d-4490-9bb7-32340a09c4e7 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:13.452784 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-38fd42aa-49e0-4bdd-b8cc-2dc75c6fd94a req-a516536e-367d-4490-9bb7-32340a09c4e7 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:13.472451 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-38fd42aa-49e0-4bdd-b8cc-2dc75c6fd94a req-a516536e-367d-4490-9bb7-32340a09c4e7 service nova] Creating event network-changed:cc85e0fe-203e-42a2-8387-fa852cacaca4 for instance 4694c0a1-7900-4032-9200-acd16f179291 on hv-cinder-85220 Sep 06 22:43:13.478633 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-38fd42aa-49e0-4bdd-b8cc-2dc75c6fd94a req-a516536e-367d-4490-9bb7-32340a09c4e7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117000 Sep 06 22:43:13.479467 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 33/60] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:43:13.728960 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-42e66745-8a6e-44e8-95f6-ede5919e561c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:13.729804 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-42e66745-8a6e-44e8-95f6-ede5919e561c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:13.737814 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-42e66745-8a6e-44e8-95f6-ede5919e561c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:13.738498 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-42e66745-8a6e-44e8-95f6-ede5919e561c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:13.739032 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-42e66745-8a6e-44e8-95f6-ede5919e561c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:13.739819 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-42e66745-8a6e-44e8-95f6-ede5919e561c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:13.741408 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-42e66745-8a6e-44e8-95f6-ede5919e561c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:13.749725 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-42e66745-8a6e-44e8-95f6-ede5919e561c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:13.900318 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6b2de388-b087-4199-8b3e-553e6e10aa3e tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:13.900964 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-6b2de388-b087-4199-8b3e-553e6e10aa3e tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:13.907405 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6b2de388-b087-4199-8b3e-553e6e10aa3e tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:13.907901 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6b2de388-b087-4199-8b3e-553e6e10aa3e tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:13.908332 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6b2de388-b087-4199-8b3e-553e6e10aa3e tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:13.909056 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6b2de388-b087-4199-8b3e-553e6e10aa3e tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:13.909504 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6b2de388-b087-4199-8b3e-553e6e10aa3e tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:13.909923 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6b2de388-b087-4199-8b3e-553e6e10aa3e tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:14.087571 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-42e66745-8a6e-44e8-95f6-ede5919e561c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:14.095920 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-42e66745-8a6e-44e8-95f6-ede5919e561c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1322 microversion: 2.1 time: 0.372201 Sep 06 22:43:14.096628 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 28/61] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:13 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1322 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:14.101463 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-ed110eb5-8a31-442b-ac12-4f9e3171ef4c req-0d53fb75-dcf1-477b-af23-314215b7e2b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bd3f7df-0b7f-451c-b6ea-c91792e466e5", "tag": "ebeeb6bc-6ebd-470a-adfd-3cc33ae98d90"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:43:14.113600 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-ed110eb5-8a31-442b-ac12-4f9e3171ef4c req-0d53fb75-dcf1-477b-af23-314215b7e2b7 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:14.114202 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-ed110eb5-8a31-442b-ac12-4f9e3171ef4c req-0d53fb75-dcf1-477b-af23-314215b7e2b7 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:14.114701 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-ed110eb5-8a31-442b-ac12-4f9e3171ef4c req-0d53fb75-dcf1-477b-af23-314215b7e2b7 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:14.137945 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-ed110eb5-8a31-442b-ac12-4f9e3171ef4c req-0d53fb75-dcf1-477b-af23-314215b7e2b7 service nova] Creating event network-changed:ebeeb6bc-6ebd-470a-adfd-3cc33ae98d90 for instance 7bd3f7df-0b7f-451c-b6ea-c91792e466e5 on hv-cinder-85220 Sep 06 22:43:14.138594 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-ed110eb5-8a31-442b-ac12-4f9e3171ef4c req-0d53fb75-dcf1-477b-af23-314215b7e2b7 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127088) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 06 22:43:14.139190 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-ed110eb5-8a31-442b-ac12-4f9e3171ef4c req-0d53fb75-dcf1-477b-af23-314215b7e2b7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127088) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 06 22:43:14.141385 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-910c7fc2-a448-4279-a080-9782976a6433 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:14.141945 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-910c7fc2-a448-4279-a080-9782976a6433 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:14.142429 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-910c7fc2-a448-4279-a080-9782976a6433 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:14.143204 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-910c7fc2-a448-4279-a080-9782976a6433 None None] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:14.144035 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-910c7fc2-a448-4279-a080-9782976a6433 None None] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:14.144509 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-910c7fc2-a448-4279-a080-9782976a6433 None None] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:14.154066 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.compute.rpcapi [None req-910c7fc2-a448-4279-a080-9782976a6433 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 06 22:43:14.155025 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-910c7fc2-a448-4279-a080-9782976a6433 None None] Releasing lock "compute-rpcapi-router" {{(pid=127088) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 06 22:43:14.170998 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-910c7fc2-a448-4279-a080-9782976a6433 None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072933 Sep 06 22:43:14.171976 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 29/62] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:43:14.177639 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ffd81edb-0c6e-48ec-a988-c99dd0c41bd8 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:14.178327 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ffd81edb-0c6e-48ec-a988-c99dd0c41bd8 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:14.179896 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6b2de388-b087-4199-8b3e-553e6e10aa3e tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5264060ddd48afa8305c38a9bfa4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f01bb55623a4bf580008b75a9715796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:14.183347 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=100 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:43:14.184537 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ffd81edb-0c6e-48ec-a988-c99dd0c41bd8 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:14.185127 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ffd81edb-0c6e-48ec-a988-c99dd0c41bd8 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:14.185622 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ffd81edb-0c6e-48ec-a988-c99dd0c41bd8 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:14.186476 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ffd81edb-0c6e-48ec-a988-c99dd0c41bd8 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:14.186919 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ffd81edb-0c6e-48ec-a988-c99dd0c41bd8 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:14.187992 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ffd81edb-0c6e-48ec-a988-c99dd0c41bd8 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:14.189670 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-6b2de388-b087-4199-8b3e-553e6e10aa3e tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291" status: 200 len: 1314 microversion: 2.1 time: 0.293503 Sep 06 22:43:14.190247 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 34/63] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:13 2022] GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:43:14.200685 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-149576bf-64e4-4a08-8629-8a9007911f5e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:14.201511 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-149576bf-64e4-4a08-8629-8a9007911f5e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:14.209753 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-149576bf-64e4-4a08-8629-8a9007911f5e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:14.210236 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-149576bf-64e4-4a08-8629-8a9007911f5e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:14.210839 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-149576bf-64e4-4a08-8629-8a9007911f5e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:14.211659 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-149576bf-64e4-4a08-8629-8a9007911f5e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:14.212002 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-149576bf-64e4-4a08-8629-8a9007911f5e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:14.212422 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-149576bf-64e4-4a08-8629-8a9007911f5e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:14.255854 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ffd81edb-0c6e-48ec-a988-c99dd0c41bd8 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:14.268083 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ffd81edb-0c6e-48ec-a988-c99dd0c41bd8 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:14.269896 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ffd81edb-0c6e-48ec-a988-c99dd0c41bd8 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:14.271175 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ffd81edb-0c6e-48ec-a988-c99dd0c41bd8 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1339 microversion: 2.20 time: 0.097913 Sep 06 22:43:14.271725 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 30/64] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:43:14 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1339 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:43:14.365966 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-149576bf-64e4-4a08-8629-8a9007911f5e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:14.373540 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-149576bf-64e4-4a08-8629-8a9007911f5e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1363 microversion: 2.1 time: 0.176824 Sep 06 22:43:14.374091 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 35/65] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:14 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:15.120485 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-978e5789-99fe-4627-b347-0bb66be5c875 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:15.121160 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-978e5789-99fe-4627-b347-0bb66be5c875 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:15.130693 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:43:15.133007 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-978e5789-99fe-4627-b347-0bb66be5c875 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:15.133868 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-978e5789-99fe-4627-b347-0bb66be5c875 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:15.134472 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-978e5789-99fe-4627-b347-0bb66be5c875 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:15.135941 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-978e5789-99fe-4627-b347-0bb66be5c875 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:15.136542 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-978e5789-99fe-4627-b347-0bb66be5c875 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:15.137164 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-978e5789-99fe-4627-b347-0bb66be5c875 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:15.215801 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-eae24836-76c7-4588-a7d6-18a3fe7b1c78 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:15.216936 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-eae24836-76c7-4588-a7d6-18a3fe7b1c78 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:15.223759 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-eae24836-76c7-4588-a7d6-18a3fe7b1c78 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:15.224258 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-eae24836-76c7-4588-a7d6-18a3fe7b1c78 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:15.224721 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-eae24836-76c7-4588-a7d6-18a3fe7b1c78 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:15.225474 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-eae24836-76c7-4588-a7d6-18a3fe7b1c78 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:15.225926 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-eae24836-76c7-4588-a7d6-18a3fe7b1c78 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:15.226596 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-eae24836-76c7-4588-a7d6-18a3fe7b1c78 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:15.416032 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-eae24836-76c7-4588-a7d6-18a3fe7b1c78 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5264060ddd48afa8305c38a9bfa4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f01bb55623a4bf580008b75a9715796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:15.423306 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-978e5789-99fe-4627-b347-0bb66be5c875 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:15.425450 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-eae24836-76c7-4588-a7d6-18a3fe7b1c78 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291" status: 200 len: 1314 microversion: 2.1 time: 0.214358 Sep 06 22:43:15.438182 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 36/66] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:15 2022] GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:15.439673 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-978e5789-99fe-4627-b347-0bb66be5c875 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1322 microversion: 2.1 time: 0.323716 Sep 06 22:43:15.440710 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 31/67] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:15 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1322 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:15.453720 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6574a5bb-e76c-46f3-a3e7-25c571568848 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:15.453720 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-6574a5bb-e76c-46f3-a3e7-25c571568848 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:15.457980 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6574a5bb-e76c-46f3-a3e7-25c571568848 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:15.458864 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6574a5bb-e76c-46f3-a3e7-25c571568848 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:15.459476 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6574a5bb-e76c-46f3-a3e7-25c571568848 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:15.460431 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6574a5bb-e76c-46f3-a3e7-25c571568848 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:15.461055 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6574a5bb-e76c-46f3-a3e7-25c571568848 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:15.461700 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6574a5bb-e76c-46f3-a3e7-25c571568848 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:15.471935 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-09a118c3-8e48-41f9-bf47-c380d0c110d1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:15.473188 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-09a118c3-8e48-41f9-bf47-c380d0c110d1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:15.484941 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-09a118c3-8e48-41f9-bf47-c380d0c110d1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:15.485979 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-09a118c3-8e48-41f9-bf47-c380d0c110d1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:15.486636 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-09a118c3-8e48-41f9-bf47-c380d0c110d1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:15.487726 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-09a118c3-8e48-41f9-bf47-c380d0c110d1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:15.488667 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-09a118c3-8e48-41f9-bf47-c380d0c110d1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:15.489313 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-09a118c3-8e48-41f9-bf47-c380d0c110d1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:15.543702 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6574a5bb-e76c-46f3-a3e7-25c571568848 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:15.559050 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6574a5bb-e76c-46f3-a3e7-25c571568848 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:15.564558 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6574a5bb-e76c-46f3-a3e7-25c571568848 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:15.574989 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-6574a5bb-e76c-46f3-a3e7-25c571568848 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1339 microversion: 2.20 time: 0.123281 Sep 06 22:43:15.586342 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 37/68] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:43:15 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1339 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:43:15.598521 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-6283b918-7304-414e-abca-6d03c5bf7f8a req-f26103d1-6483-4a5f-a1e3-3778f7287b4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eea64584-7d61-47f0-8296-25586329f9b5", "tag": "dad54419-8127-4e01-9006-f6c4183bdfa4"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:43:15.628996 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-6283b918-7304-414e-abca-6d03c5bf7f8a req-f26103d1-6483-4a5f-a1e3-3778f7287b4e service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:15.629457 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-6283b918-7304-414e-abca-6d03c5bf7f8a req-f26103d1-6483-4a5f-a1e3-3778f7287b4e service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:15.629901 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-6283b918-7304-414e-abca-6d03c5bf7f8a req-f26103d1-6483-4a5f-a1e3-3778f7287b4e service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:15.659722 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-6283b918-7304-414e-abca-6d03c5bf7f8a req-f26103d1-6483-4a5f-a1e3-3778f7287b4e service nova] Creating event network-changed:dad54419-8127-4e01-9006-f6c4183bdfa4 for instance eea64584-7d61-47f0-8296-25586329f9b5 on hv-cinder-85220 Sep 06 22:43:15.666231 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-6283b918-7304-414e-abca-6d03c5bf7f8a req-f26103d1-6483-4a5f-a1e3-3778f7287b4e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078419 Sep 06 22:43:15.667761 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 38/69] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:43:15.793412 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-09a118c3-8e48-41f9-bf47-c380d0c110d1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:15.817359 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-09a118c3-8e48-41f9-bf47-c380d0c110d1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1363 microversion: 2.1 time: 0.355023 Sep 06 22:43:15.821670 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 32/70] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:15 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1363 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:16.451961 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-60fd5821-cd5d-454b-86a8-dab036881479 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:16.453334 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-60fd5821-cd5d-454b-86a8-dab036881479 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:16.460240 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-60fd5821-cd5d-454b-86a8-dab036881479 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:16.461002 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-60fd5821-cd5d-454b-86a8-dab036881479 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:16.461441 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-60fd5821-cd5d-454b-86a8-dab036881479 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:16.462139 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-60fd5821-cd5d-454b-86a8-dab036881479 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:16.462743 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-60fd5821-cd5d-454b-86a8-dab036881479 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:16.463302 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-60fd5821-cd5d-454b-86a8-dab036881479 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:16.474485 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6c32f175-4307-4f6b-ae09-d5fb82227818 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:16.476094 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6c32f175-4307-4f6b-ae09-d5fb82227818 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:16.479575 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=28 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:43:16.486113 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c32f175-4307-4f6b-ae09-d5fb82227818 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:16.486609 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c32f175-4307-4f6b-ae09-d5fb82227818 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:16.487028 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c32f175-4307-4f6b-ae09-d5fb82227818 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:16.487732 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c32f175-4307-4f6b-ae09-d5fb82227818 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:16.488177 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c32f175-4307-4f6b-ae09-d5fb82227818 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:16.488594 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c32f175-4307-4f6b-ae09-d5fb82227818 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:16.774146 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6c32f175-4307-4f6b-ae09-d5fb82227818 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:16.783357 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6c32f175-4307-4f6b-ae09-d5fb82227818 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1322 microversion: 2.1 time: 0.315984 Sep 06 22:43:16.784985 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 33/71] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:16 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1322 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:43:16.789710 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9b2c8767-a68b-4b1f-a9c1-6f6c8c82e868 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:16.790927 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9b2c8767-a68b-4b1f-a9c1-6f6c8c82e868 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:16.800262 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-60fd5821-cd5d-454b-86a8-dab036881479 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5264060ddd48afa8305c38a9bfa4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f01bb55623a4bf580008b75a9715796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:16.806099 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b2c8767-a68b-4b1f-a9c1-6f6c8c82e868 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:16.806964 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b2c8767-a68b-4b1f-a9c1-6f6c8c82e868 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:16.807585 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b2c8767-a68b-4b1f-a9c1-6f6c8c82e868 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:16.808787 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b2c8767-a68b-4b1f-a9c1-6f6c8c82e868 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:16.809421 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b2c8767-a68b-4b1f-a9c1-6f6c8c82e868 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:16.810070 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9b2c8767-a68b-4b1f-a9c1-6f6c8c82e868 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:16.811338 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-60fd5821-cd5d-454b-86a8-dab036881479 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291" status: 200 len: 1314 microversion: 2.1 time: 0.363683 Sep 06 22:43:16.814144 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 39/72] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:16 2022] GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:16.850240 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-cc4a2940-9185-4c92-974e-4df0467d9952 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:16.852055 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-cc4a2940-9185-4c92-974e-4df0467d9952 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:16.859718 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:43:16.863856 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cc4a2940-9185-4c92-974e-4df0467d9952 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:16.864433 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cc4a2940-9185-4c92-974e-4df0467d9952 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:16.864966 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cc4a2940-9185-4c92-974e-4df0467d9952 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:16.866185 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cc4a2940-9185-4c92-974e-4df0467d9952 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:16.866988 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cc4a2940-9185-4c92-974e-4df0467d9952 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:16.867650 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cc4a2940-9185-4c92-974e-4df0467d9952 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:16.923628 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9b2c8767-a68b-4b1f-a9c1-6f6c8c82e868 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:16.927552 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:43:16.936309 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9b2c8767-a68b-4b1f-a9c1-6f6c8c82e868 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:16.945773 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9b2c8767-a68b-4b1f-a9c1-6f6c8c82e868 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:16.947056 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9b2c8767-a68b-4b1f-a9c1-6f6c8c82e868 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1339 microversion: 2.20 time: 0.160949 Sep 06 22:43:16.948044 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 34/73] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:43:16 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1339 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:43:17.088062 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=20 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:43:17.118712 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-cc4a2940-9185-4c92-974e-4df0467d9952 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:17.129265 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-cc4a2940-9185-4c92-974e-4df0467d9952 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1363 microversion: 2.1 time: 0.283226 Sep 06 22:43:17.130591 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 40/74] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:16 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1363 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:17.809189 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-97eacdca-ac23-41e7-b6a3-d49c41de483c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:17.809807 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-97eacdca-ac23-41e7-b6a3-d49c41de483c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:17.824165 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-97eacdca-ac23-41e7-b6a3-d49c41de483c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:17.829555 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-97eacdca-ac23-41e7-b6a3-d49c41de483c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:17.830212 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-97eacdca-ac23-41e7-b6a3-d49c41de483c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:17.831157 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-97eacdca-ac23-41e7-b6a3-d49c41de483c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:17.832148 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-97eacdca-ac23-41e7-b6a3-d49c41de483c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:17.832863 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-97eacdca-ac23-41e7-b6a3-d49c41de483c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:17.840751 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9db3d589-2595-40e7-aee1-cd82f64b9994 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:17.842717 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9db3d589-2595-40e7-aee1-cd82f64b9994 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:17.862180 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9db3d589-2595-40e7-aee1-cd82f64b9994 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:17.863807 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9db3d589-2595-40e7-aee1-cd82f64b9994 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:17.864582 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9db3d589-2595-40e7-aee1-cd82f64b9994 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:17.869516 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9db3d589-2595-40e7-aee1-cd82f64b9994 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:17.870760 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9db3d589-2595-40e7-aee1-cd82f64b9994 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:17.871779 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9db3d589-2595-40e7-aee1-cd82f64b9994 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:18.231071 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-97eacdca-ac23-41e7-b6a3-d49c41de483c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:18.242277 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-97eacdca-ac23-41e7-b6a3-d49c41de483c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1322 microversion: 2.1 time: 0.436843 Sep 06 22:43:18.246862 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 35/75] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:17 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1322 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:18.256522 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2e46a27b-d4b5-43e3-9321-9f94bcf017f9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:18.257082 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2e46a27b-d4b5-43e3-9321-9f94bcf017f9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:18.265827 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9db3d589-2595-40e7-aee1-cd82f64b9994 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5264060ddd48afa8305c38a9bfa4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f01bb55623a4bf580008b75a9715796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:18.276111 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9db3d589-2595-40e7-aee1-cd82f64b9994 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291" status: 200 len: 1314 microversion: 2.1 time: 0.441376 Sep 06 22:43:18.279557 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e46a27b-d4b5-43e3-9321-9f94bcf017f9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:18.279996 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 41/76] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:17 2022] GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:18.280488 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e46a27b-d4b5-43e3-9321-9f94bcf017f9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:18.281871 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e46a27b-d4b5-43e3-9321-9f94bcf017f9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:18.282833 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e46a27b-d4b5-43e3-9321-9f94bcf017f9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:18.287967 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-7da6e74e-6243-4338-bb8a-7de57b5566ff tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:18.288613 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e46a27b-d4b5-43e3-9321-9f94bcf017f9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:18.288748 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-7da6e74e-6243-4338-bb8a-7de57b5566ff tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:18.290043 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e46a27b-d4b5-43e3-9321-9f94bcf017f9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:18.309851 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7da6e74e-6243-4338-bb8a-7de57b5566ff tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:18.315621 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7da6e74e-6243-4338-bb8a-7de57b5566ff tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:18.316430 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7da6e74e-6243-4338-bb8a-7de57b5566ff tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:18.317810 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7da6e74e-6243-4338-bb8a-7de57b5566ff tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:18.318430 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7da6e74e-6243-4338-bb8a-7de57b5566ff tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:18.319030 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7da6e74e-6243-4338-bb8a-7de57b5566ff tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:18.450770 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2e46a27b-d4b5-43e3-9321-9f94bcf017f9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:18.460194 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2e46a27b-d4b5-43e3-9321-9f94bcf017f9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:18.462198 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2e46a27b-d4b5-43e3-9321-9f94bcf017f9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:18.463993 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2e46a27b-d4b5-43e3-9321-9f94bcf017f9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1339 microversion: 2.20 time: 0.215402 Sep 06 22:43:18.464848 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 36/77] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:43:18 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1339 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:43:18.569933 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-7da6e74e-6243-4338-bb8a-7de57b5566ff tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:18.579577 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-7da6e74e-6243-4338-bb8a-7de57b5566ff tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1363 microversion: 2.1 time: 0.298341 Sep 06 22:43:18.580157 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 42/78] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:18 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1363 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:19.273793 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bc1bdb97-6fba-4adb-91a0-5f526fba74a8 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:19.274487 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bc1bdb97-6fba-4adb-91a0-5f526fba74a8 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:19.280557 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc1bdb97-6fba-4adb-91a0-5f526fba74a8 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:19.281160 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc1bdb97-6fba-4adb-91a0-5f526fba74a8 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:19.281788 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc1bdb97-6fba-4adb-91a0-5f526fba74a8 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:19.282394 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc1bdb97-6fba-4adb-91a0-5f526fba74a8 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:19.282844 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc1bdb97-6fba-4adb-91a0-5f526fba74a8 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:19.283272 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc1bdb97-6fba-4adb-91a0-5f526fba74a8 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:19.301424 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d445ce7b-f725-4dac-b3b4-d8dd79fd55e2 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:19.302046 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-d445ce7b-f725-4dac-b3b4-d8dd79fd55e2 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:19.308021 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d445ce7b-f725-4dac-b3b4-d8dd79fd55e2 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:19.308513 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d445ce7b-f725-4dac-b3b4-d8dd79fd55e2 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:19.308977 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d445ce7b-f725-4dac-b3b4-d8dd79fd55e2 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:19.309672 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d445ce7b-f725-4dac-b3b4-d8dd79fd55e2 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:19.310125 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d445ce7b-f725-4dac-b3b4-d8dd79fd55e2 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:19.310549 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d445ce7b-f725-4dac-b3b4-d8dd79fd55e2 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:19.470284 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bc1bdb97-6fba-4adb-91a0-5f526fba74a8 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:19.479311 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bc1bdb97-6fba-4adb-91a0-5f526fba74a8 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1322 microversion: 2.1 time: 0.209667 Sep 06 22:43:19.480363 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 37/79] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:19 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:19.494406 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c2c1ba8f-0336-444e-9400-96084d796902 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:19.495009 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c2c1ba8f-0336-444e-9400-96084d796902 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:19.498835 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-d445ce7b-f725-4dac-b3b4-d8dd79fd55e2 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5264060ddd48afa8305c38a9bfa4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f01bb55623a4bf580008b75a9715796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:19.501547 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c2c1ba8f-0336-444e-9400-96084d796902 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:19.502027 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c2c1ba8f-0336-444e-9400-96084d796902 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:19.502445 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c2c1ba8f-0336-444e-9400-96084d796902 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:19.503308 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c2c1ba8f-0336-444e-9400-96084d796902 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:19.503897 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c2c1ba8f-0336-444e-9400-96084d796902 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:19.504318 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c2c1ba8f-0336-444e-9400-96084d796902 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:19.507018 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d445ce7b-f725-4dac-b3b4-d8dd79fd55e2 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291" status: 200 len: 1314 microversion: 2.1 time: 0.209415 Sep 06 22:43:19.507663 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 43/80] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:19 2022] GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:43:19.566950 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c2c1ba8f-0336-444e-9400-96084d796902 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:19.576647 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c2c1ba8f-0336-444e-9400-96084d796902 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:19.576744 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c2c1ba8f-0336-444e-9400-96084d796902 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:19.577829 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c2c1ba8f-0336-444e-9400-96084d796902 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1339 microversion: 2.20 time: 0.087546 Sep 06 22:43:19.581067 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 38/81] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:43:19 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1339 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:43:19.603281 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-dc5c981f-733e-4aa1-948e-9d8dbb977f09 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:19.603876 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-dc5c981f-733e-4aa1-948e-9d8dbb977f09 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:19.610190 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dc5c981f-733e-4aa1-948e-9d8dbb977f09 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:19.610661 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dc5c981f-733e-4aa1-948e-9d8dbb977f09 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:19.611116 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dc5c981f-733e-4aa1-948e-9d8dbb977f09 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:19.611791 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dc5c981f-733e-4aa1-948e-9d8dbb977f09 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:19.612230 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dc5c981f-733e-4aa1-948e-9d8dbb977f09 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:19.612644 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dc5c981f-733e-4aa1-948e-9d8dbb977f09 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:19.745327 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-dc5c981f-733e-4aa1-948e-9d8dbb977f09 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:19.753918 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-dc5c981f-733e-4aa1-948e-9d8dbb977f09 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1363 microversion: 2.1 time: 0.154304 Sep 06 22:43:19.754500 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 44/82] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:19 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:20.503378 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f61bea08-f938-4b5b-ade8-0e7c28558f26 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:20.504057 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f61bea08-f938-4b5b-ade8-0e7c28558f26 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:20.509996 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f61bea08-f938-4b5b-ade8-0e7c28558f26 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:20.510481 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f61bea08-f938-4b5b-ade8-0e7c28558f26 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:20.511095 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f61bea08-f938-4b5b-ade8-0e7c28558f26 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:20.512123 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f61bea08-f938-4b5b-ade8-0e7c28558f26 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:20.512822 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f61bea08-f938-4b5b-ade8-0e7c28558f26 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:20.513385 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f61bea08-f938-4b5b-ade8-0e7c28558f26 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:20.531536 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-2f8fa179-a619-4c9a-87f0-b668a5b9bd10 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:20.532179 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-2f8fa179-a619-4c9a-87f0-b668a5b9bd10 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:20.542375 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2f8fa179-a619-4c9a-87f0-b668a5b9bd10 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:20.542867 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2f8fa179-a619-4c9a-87f0-b668a5b9bd10 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:20.543456 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2f8fa179-a619-4c9a-87f0-b668a5b9bd10 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:20.544195 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2f8fa179-a619-4c9a-87f0-b668a5b9bd10 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:20.544647 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2f8fa179-a619-4c9a-87f0-b668a5b9bd10 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:20.545100 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2f8fa179-a619-4c9a-87f0-b668a5b9bd10 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:20.729627 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-2f8fa179-a619-4c9a-87f0-b668a5b9bd10 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5264060ddd48afa8305c38a9bfa4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f01bb55623a4bf580008b75a9715796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:20.739752 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-2f8fa179-a619-4c9a-87f0-b668a5b9bd10 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291" status: 200 len: 1314 microversion: 2.1 time: 0.212252 Sep 06 22:43:20.740411 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 45/83] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:20 2022] GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:43:20.741326 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f61bea08-f938-4b5b-ade8-0e7c28558f26 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:20.745198 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e9be547e-b054-4449-86a3-961a095ab658 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:20.745870 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e9be547e-b054-4449-86a3-961a095ab658 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:20.751454 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f61bea08-f938-4b5b-ade8-0e7c28558f26 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1322 microversion: 2.1 time: 0.253201 Sep 06 22:43:20.751871 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e9be547e-b054-4449-86a3-961a095ab658 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:20.752172 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 39/84] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:20 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:20.759251 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e9be547e-b054-4449-86a3-961a095ab658 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:20.759705 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e9be547e-b054-4449-86a3-961a095ab658 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:20.760413 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e9be547e-b054-4449-86a3-961a095ab658 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:20.760899 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e9be547e-b054-4449-86a3-961a095ab658 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:20.761319 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e9be547e-b054-4449-86a3-961a095ab658 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:20.776746 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-be0d6ba1-625b-4439-91d6-55d0b0209d1e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:20.777374 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-be0d6ba1-625b-4439-91d6-55d0b0209d1e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:20.784266 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-be0d6ba1-625b-4439-91d6-55d0b0209d1e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:20.784740 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-be0d6ba1-625b-4439-91d6-55d0b0209d1e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:20.785190 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-be0d6ba1-625b-4439-91d6-55d0b0209d1e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:20.785871 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-be0d6ba1-625b-4439-91d6-55d0b0209d1e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:20.786311 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-be0d6ba1-625b-4439-91d6-55d0b0209d1e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:20.786722 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-be0d6ba1-625b-4439-91d6-55d0b0209d1e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:20.826368 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e9be547e-b054-4449-86a3-961a095ab658 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:20.834683 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e9be547e-b054-4449-86a3-961a095ab658 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:20.836122 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e9be547e-b054-4449-86a3-961a095ab658 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:20.837235 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e9be547e-b054-4449-86a3-961a095ab658 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1339 microversion: 2.20 time: 0.095708 Sep 06 22:43:20.837784 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 46/85] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:43:20 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1339 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:43:20.924245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-be0d6ba1-625b-4439-91d6-55d0b0209d1e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:20.931924 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-be0d6ba1-625b-4439-91d6-55d0b0209d1e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1363 microversion: 2.1 time: 0.159054 Sep 06 22:43:20.932481 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 40/86] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:20 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:43:21.762358 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f0567834-2547-45df-8ae2-c6a085026d9c tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:21.762964 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-f0567834-2547-45df-8ae2-c6a085026d9c tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:21.771721 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f0567834-2547-45df-8ae2-c6a085026d9c tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:21.772216 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f0567834-2547-45df-8ae2-c6a085026d9c tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:21.772645 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f0567834-2547-45df-8ae2-c6a085026d9c tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:21.773368 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f0567834-2547-45df-8ae2-c6a085026d9c tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:21.773814 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f0567834-2547-45df-8ae2-c6a085026d9c tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:21.775038 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7694c5f8-1163-4706-9538-1ce51f63422a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:21.775523 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f0567834-2547-45df-8ae2-c6a085026d9c tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:21.776407 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7694c5f8-1163-4706-9538-1ce51f63422a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:21.784383 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7694c5f8-1163-4706-9538-1ce51f63422a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:21.785318 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7694c5f8-1163-4706-9538-1ce51f63422a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:21.785901 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7694c5f8-1163-4706-9538-1ce51f63422a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:21.786878 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7694c5f8-1163-4706-9538-1ce51f63422a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:21.787365 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7694c5f8-1163-4706-9538-1ce51f63422a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:21.787975 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7694c5f8-1163-4706-9538-1ce51f63422a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:21.967529 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=2 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:43:22.069895 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-f0567834-2547-45df-8ae2-c6a085026d9c tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5264060ddd48afa8305c38a9bfa4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f01bb55623a4bf580008b75a9715796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:22.077587 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-f0567834-2547-45df-8ae2-c6a085026d9c tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291" status: 200 len: 1314 microversion: 2.1 time: 0.319142 Sep 06 22:43:22.092715 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 47/87] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:21 2022] GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:22.093256 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7694c5f8-1163-4706-9538-1ce51f63422a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:22.093256 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7694c5f8-1163-4706-9538-1ce51f63422a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1322 microversion: 2.1 time: 0.320905 Sep 06 22:43:22.093256 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 41/88] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:21 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1322 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:22.100376 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-547def1e-42f0-4026-af64-434b10e6e49d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:22.101481 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-43e556a1-ab7f-48f4-8681-3476536bdfd1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:22.102041 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-547def1e-42f0-4026-af64-434b10e6e49d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:22.102634 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-43e556a1-ab7f-48f4-8681-3476536bdfd1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:22.113685 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-547def1e-42f0-4026-af64-434b10e6e49d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:22.113876 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-43e556a1-ab7f-48f4-8681-3476536bdfd1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:22.114414 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-43e556a1-ab7f-48f4-8681-3476536bdfd1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:22.114562 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-547def1e-42f0-4026-af64-434b10e6e49d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:22.114985 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-547def1e-42f0-4026-af64-434b10e6e49d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:22.115102 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-43e556a1-ab7f-48f4-8681-3476536bdfd1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:22.115687 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-547def1e-42f0-4026-af64-434b10e6e49d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:22.116526 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-43e556a1-ab7f-48f4-8681-3476536bdfd1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:22.116643 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-547def1e-42f0-4026-af64-434b10e6e49d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:22.116732 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-43e556a1-ab7f-48f4-8681-3476536bdfd1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:22.116846 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-547def1e-42f0-4026-af64-434b10e6e49d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:22.117286 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-43e556a1-ab7f-48f4-8681-3476536bdfd1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:22.373151 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-43e556a1-ab7f-48f4-8681-3476536bdfd1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:22.377596 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-547def1e-42f0-4026-af64-434b10e6e49d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:22.383315 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-43e556a1-ab7f-48f4-8681-3476536bdfd1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1363 microversion: 2.1 time: 0.289522 Sep 06 22:43:22.383899 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 42/89] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:22 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1363 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:22.387776 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-547def1e-42f0-4026-af64-434b10e6e49d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:22.389260 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-547def1e-42f0-4026-af64-434b10e6e49d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:22.390774 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-547def1e-42f0-4026-af64-434b10e6e49d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1407 microversion: 2.20 time: 0.310633 Sep 06 22:43:22.391328 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 48/90] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:43:22 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1407 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:43:23.102907 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bca29799-f55c-4aa5-a01a-74a16884d9f3 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:23.103517 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bca29799-f55c-4aa5-a01a-74a16884d9f3 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:23.109721 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bca29799-f55c-4aa5-a01a-74a16884d9f3 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:23.110207 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bca29799-f55c-4aa5-a01a-74a16884d9f3 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:23.110642 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bca29799-f55c-4aa5-a01a-74a16884d9f3 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:23.111331 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bca29799-f55c-4aa5-a01a-74a16884d9f3 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:23.111782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bca29799-f55c-4aa5-a01a-74a16884d9f3 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:23.112204 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bca29799-f55c-4aa5-a01a-74a16884d9f3 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:23.115165 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-182822e8-bd5b-4047-827e-5b91ea412e02 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:23.115761 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-182822e8-bd5b-4047-827e-5b91ea412e02 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:23.121662 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-182822e8-bd5b-4047-827e-5b91ea412e02 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:23.122138 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-182822e8-bd5b-4047-827e-5b91ea412e02 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:23.122562 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-182822e8-bd5b-4047-827e-5b91ea412e02 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:23.123234 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-182822e8-bd5b-4047-827e-5b91ea412e02 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:23.123675 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-182822e8-bd5b-4047-827e-5b91ea412e02 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:23.124086 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-182822e8-bd5b-4047-827e-5b91ea412e02 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:23.307680 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bca29799-f55c-4aa5-a01a-74a16884d9f3 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5264060ddd48afa8305c38a9bfa4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f01bb55623a4bf580008b75a9715796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:23.315178 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-182822e8-bd5b-4047-827e-5b91ea412e02 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:23.316097 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bca29799-f55c-4aa5-a01a-74a16884d9f3 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291" status: 200 len: 1314 microversion: 2.1 time: 0.216993 Sep 06 22:43:23.316679 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 43/91] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:23 2022] GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:23.323006 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-182822e8-bd5b-4047-827e-5b91ea412e02 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1322 microversion: 2.1 time: 0.211607 Sep 06 22:43:23.323644 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 49/92] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:23 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:23.406557 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8f3117aa-7012-4cee-ae9c-c962782c3919 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:23.407164 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8f3117aa-7012-4cee-ae9c-c962782c3919 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:23.413157 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f3117aa-7012-4cee-ae9c-c962782c3919 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:23.413639 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f3117aa-7012-4cee-ae9c-c962782c3919 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:23.414069 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f3117aa-7012-4cee-ae9c-c962782c3919 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:23.414748 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f3117aa-7012-4cee-ae9c-c962782c3919 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:23.415194 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f3117aa-7012-4cee-ae9c-c962782c3919 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:23.415607 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f3117aa-7012-4cee-ae9c-c962782c3919 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:23.416661 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-5a3778ae-f38b-4be6-ac3b-53afd4258dc5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:23.417307 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-5a3778ae-f38b-4be6-ac3b-53afd4258dc5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:23.424079 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5a3778ae-f38b-4be6-ac3b-53afd4258dc5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:23.424554 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5a3778ae-f38b-4be6-ac3b-53afd4258dc5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:23.425018 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5a3778ae-f38b-4be6-ac3b-53afd4258dc5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:23.425716 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5a3778ae-f38b-4be6-ac3b-53afd4258dc5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:23.426143 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5a3778ae-f38b-4be6-ac3b-53afd4258dc5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:23.426561 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5a3778ae-f38b-4be6-ac3b-53afd4258dc5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:23.779604 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8f3117aa-7012-4cee-ae9c-c962782c3919 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:23.784543 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-5a3778ae-f38b-4be6-ac3b-53afd4258dc5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:23.788739 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8f3117aa-7012-4cee-ae9c-c962782c3919 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1363 microversion: 2.1 time: 0.386480 Sep 06 22:43:23.789345 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 44/93] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:23 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1363 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:23.792954 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-5a3778ae-f38b-4be6-ac3b-53afd4258dc5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:23.794606 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-5a3778ae-f38b-4be6-ac3b-53afd4258dc5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:23.795856 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-5a3778ae-f38b-4be6-ac3b-53afd4258dc5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1407 microversion: 2.20 time: 0.383089 Sep 06 22:43:23.796485 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 50/94] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:43:23 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1407 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 22:43:24.339424 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-78969726-1865-49d6-90d1-8bc73b953871 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:24.340139 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-78969726-1865-49d6-90d1-8bc73b953871 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:24.341995 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=8 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:43:24.346495 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e2ecfd7e-c987-49c7-b429-c6361106002f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:24.347245 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e2ecfd7e-c987-49c7-b429-c6361106002f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:24.348186 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-78969726-1865-49d6-90d1-8bc73b953871 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:24.348668 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-78969726-1865-49d6-90d1-8bc73b953871 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:24.349304 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-78969726-1865-49d6-90d1-8bc73b953871 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:24.349992 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-78969726-1865-49d6-90d1-8bc73b953871 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:24.350433 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-78969726-1865-49d6-90d1-8bc73b953871 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:24.350845 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-78969726-1865-49d6-90d1-8bc73b953871 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:24.353142 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e2ecfd7e-c987-49c7-b429-c6361106002f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:24.353811 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e2ecfd7e-c987-49c7-b429-c6361106002f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:24.354253 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e2ecfd7e-c987-49c7-b429-c6361106002f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:24.354950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e2ecfd7e-c987-49c7-b429-c6361106002f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:24.355399 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e2ecfd7e-c987-49c7-b429-c6361106002f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:24.355818 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e2ecfd7e-c987-49c7-b429-c6361106002f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:24.538764 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-78969726-1865-49d6-90d1-8bc73b953871 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5264060ddd48afa8305c38a9bfa4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f01bb55623a4bf580008b75a9715796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:24.542615 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e2ecfd7e-c987-49c7-b429-c6361106002f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:24.546543 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-78969726-1865-49d6-90d1-8bc73b953871 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291" status: 200 len: 1314 microversion: 2.1 time: 0.210863 Sep 06 22:43:24.547516 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 45/95] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:24 2022] GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:24.551771 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e2ecfd7e-c987-49c7-b429-c6361106002f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1322 microversion: 2.1 time: 0.210584 Sep 06 22:43:24.552502 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 51/96] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:24 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:43:24.811320 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c388eaea-d817-407a-81a5-3b31aa2c21ef tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:24.811934 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c388eaea-d817-407a-81a5-3b31aa2c21ef tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:24.818416 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c388eaea-d817-407a-81a5-3b31aa2c21ef tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:24.818901 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c388eaea-d817-407a-81a5-3b31aa2c21ef tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:24.819335 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c388eaea-d817-407a-81a5-3b31aa2c21ef tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:24.820032 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c388eaea-d817-407a-81a5-3b31aa2c21ef tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:24.820486 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c388eaea-d817-407a-81a5-3b31aa2c21ef tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:24.820938 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c388eaea-d817-407a-81a5-3b31aa2c21ef tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:24.823977 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6ca53c2b-b028-4a5d-84cd-6055ad5f7e50 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:24.824595 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-6ca53c2b-b028-4a5d-84cd-6055ad5f7e50 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:24.838756 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6ca53c2b-b028-4a5d-84cd-6055ad5f7e50 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:24.838756 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6ca53c2b-b028-4a5d-84cd-6055ad5f7e50 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:24.838973 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6ca53c2b-b028-4a5d-84cd-6055ad5f7e50 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:24.839509 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6ca53c2b-b028-4a5d-84cd-6055ad5f7e50 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:24.839957 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6ca53c2b-b028-4a5d-84cd-6055ad5f7e50 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:24.840375 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6ca53c2b-b028-4a5d-84cd-6055ad5f7e50 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:24.844822 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=100 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:43:25.038124 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c388eaea-d817-407a-81a5-3b31aa2c21ef tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:25.041181 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6ca53c2b-b028-4a5d-84cd-6055ad5f7e50 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:25.046065 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c388eaea-d817-407a-81a5-3b31aa2c21ef tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1363 microversion: 2.1 time: 0.238577 Sep 06 22:43:25.047173 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 46/97] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:24 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1363 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:25.050214 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6ca53c2b-b028-4a5d-84cd-6055ad5f7e50 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:25.051653 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6ca53c2b-b028-4a5d-84cd-6055ad5f7e50 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:25.052729 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-6ca53c2b-b028-4a5d-84cd-6055ad5f7e50 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1407 microversion: 2.20 time: 0.234429 Sep 06 22:43:25.053305 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 52/98] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:43:24 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 22:43:25.569631 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-92470fa4-8509-41c7-965f-adb2138ca877 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:25.570255 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-92470fa4-8509-41c7-965f-adb2138ca877 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:25.576877 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92470fa4-8509-41c7-965f-adb2138ca877 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:25.577665 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92470fa4-8509-41c7-965f-adb2138ca877 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:25.578391 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92470fa4-8509-41c7-965f-adb2138ca877 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:25.579053 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92470fa4-8509-41c7-965f-adb2138ca877 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:25.579511 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92470fa4-8509-41c7-965f-adb2138ca877 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:25.580241 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92470fa4-8509-41c7-965f-adb2138ca877 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:25.583219 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-c40f80cb-5eea-47c2-acf0-113bc06666a6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:25.583970 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-c40f80cb-5eea-47c2-acf0-113bc06666a6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:25.590243 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c40f80cb-5eea-47c2-acf0-113bc06666a6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:25.590878 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c40f80cb-5eea-47c2-acf0-113bc06666a6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:25.591408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c40f80cb-5eea-47c2-acf0-113bc06666a6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:25.592280 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c40f80cb-5eea-47c2-acf0-113bc06666a6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:25.592906 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c40f80cb-5eea-47c2-acf0-113bc06666a6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:25.593963 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c40f80cb-5eea-47c2-acf0-113bc06666a6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:25.776914 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-92470fa4-8509-41c7-965f-adb2138ca877 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5264060ddd48afa8305c38a9bfa4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f01bb55623a4bf580008b75a9715796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:25.784304 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-c40f80cb-5eea-47c2-acf0-113bc06666a6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:25.784915 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-92470fa4-8509-41c7-965f-adb2138ca877 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291" status: 200 len: 1314 microversion: 2.1 time: 0.219209 Sep 06 22:43:25.785490 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 47/99] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:25 2022] GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:25.792062 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-c40f80cb-5eea-47c2-acf0-113bc06666a6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1322 microversion: 2.1 time: 0.216467 Sep 06 22:43:25.792695 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 53/100] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:25 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:26.068987 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8a4ae8df-5091-45d9-8e6f-c117fb3c3547 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:26.069623 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8a4ae8df-5091-45d9-8e6f-c117fb3c3547 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:26.075503 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8a4ae8df-5091-45d9-8e6f-c117fb3c3547 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:26.075986 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8a4ae8df-5091-45d9-8e6f-c117fb3c3547 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:26.076410 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8a4ae8df-5091-45d9-8e6f-c117fb3c3547 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:26.077107 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8a4ae8df-5091-45d9-8e6f-c117fb3c3547 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:26.077478 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a17018fc-a261-48e1-aab7-980cd61c2061 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:26.077582 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8a4ae8df-5091-45d9-8e6f-c117fb3c3547 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:26.077953 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8a4ae8df-5091-45d9-8e6f-c117fb3c3547 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:26.078426 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-a17018fc-a261-48e1-aab7-980cd61c2061 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:26.084208 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a17018fc-a261-48e1-aab7-980cd61c2061 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:26.084681 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a17018fc-a261-48e1-aab7-980cd61c2061 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:26.085135 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a17018fc-a261-48e1-aab7-980cd61c2061 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:26.085809 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a17018fc-a261-48e1-aab7-980cd61c2061 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:26.086250 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a17018fc-a261-48e1-aab7-980cd61c2061 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:26.086661 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a17018fc-a261-48e1-aab7-980cd61c2061 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:26.269658 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8a4ae8df-5091-45d9-8e6f-c117fb3c3547 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:26.272868 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-a17018fc-a261-48e1-aab7-980cd61c2061 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:26.277282 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8a4ae8df-5091-45d9-8e6f-c117fb3c3547 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1363 microversion: 2.1 time: 0.212138 Sep 06 22:43:26.277848 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 48/101] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:26 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:26.282537 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-a17018fc-a261-48e1-aab7-980cd61c2061 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:26.283992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-a17018fc-a261-48e1-aab7-980cd61c2061 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:26.285115 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-a17018fc-a261-48e1-aab7-980cd61c2061 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1407 microversion: 2.20 time: 0.211424 Sep 06 22:43:26.285663 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 54/102] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:43:26 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 22:43:26.807816 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6c27efe9-c738-4626-a58b-7a4da26980b8 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:26.808351 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6c27efe9-c738-4626-a58b-7a4da26980b8 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:26.815303 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6aca0c61-1c5a-4308-a304-bfc28f177d50 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:26.815733 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c27efe9-c738-4626-a58b-7a4da26980b8 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:26.815924 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-6aca0c61-1c5a-4308-a304-bfc28f177d50 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:26.816042 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c27efe9-c738-4626-a58b-7a4da26980b8 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:26.816380 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c27efe9-c738-4626-a58b-7a4da26980b8 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:26.817188 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c27efe9-c738-4626-a58b-7a4da26980b8 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:26.817632 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c27efe9-c738-4626-a58b-7a4da26980b8 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:26.818044 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c27efe9-c738-4626-a58b-7a4da26980b8 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:26.821811 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6aca0c61-1c5a-4308-a304-bfc28f177d50 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:26.822265 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6aca0c61-1c5a-4308-a304-bfc28f177d50 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:26.822687 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6aca0c61-1c5a-4308-a304-bfc28f177d50 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:26.823360 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6aca0c61-1c5a-4308-a304-bfc28f177d50 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:26.823797 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6aca0c61-1c5a-4308-a304-bfc28f177d50 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:26.824211 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6aca0c61-1c5a-4308-a304-bfc28f177d50 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:27.017152 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6c27efe9-c738-4626-a58b-7a4da26980b8 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5264060ddd48afa8305c38a9bfa4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f01bb55623a4bf580008b75a9715796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:27.021994 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6aca0c61-1c5a-4308-a304-bfc28f177d50 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:27.025935 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6c27efe9-c738-4626-a58b-7a4da26980b8 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291" status: 200 len: 1314 microversion: 2.1 time: 0.221979 Sep 06 22:43:27.027041 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 49/103] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:26 2022] GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:27.034326 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-6aca0c61-1c5a-4308-a304-bfc28f177d50 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1322 microversion: 2.1 time: 0.223281 Sep 06 22:43:27.034934 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 55/104] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:26 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:43:27.300975 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-50879f82-173d-4136-ab68-a9f2cf6baeaa tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:27.301611 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-50879f82-173d-4136-ab68-a9f2cf6baeaa tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:27.307639 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-50879f82-173d-4136-ab68-a9f2cf6baeaa tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:27.308120 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-50879f82-173d-4136-ab68-a9f2cf6baeaa tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:27.308558 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-50879f82-173d-4136-ab68-a9f2cf6baeaa tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:27.309267 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-50879f82-173d-4136-ab68-a9f2cf6baeaa tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:27.309446 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-97b8479e-c70d-4b53-b8b8-ed3628c99ff2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:27.309715 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-50879f82-173d-4136-ab68-a9f2cf6baeaa tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:27.310038 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-97b8479e-c70d-4b53-b8b8-ed3628c99ff2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:27.310130 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-50879f82-173d-4136-ab68-a9f2cf6baeaa tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:27.316541 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-97b8479e-c70d-4b53-b8b8-ed3628c99ff2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:27.316984 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-97b8479e-c70d-4b53-b8b8-ed3628c99ff2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:27.317407 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-97b8479e-c70d-4b53-b8b8-ed3628c99ff2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:27.318076 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-97b8479e-c70d-4b53-b8b8-ed3628c99ff2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:27.318516 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-97b8479e-c70d-4b53-b8b8-ed3628c99ff2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:27.318926 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-97b8479e-c70d-4b53-b8b8-ed3628c99ff2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:27.507103 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-50879f82-173d-4136-ab68-a9f2cf6baeaa tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:27.510074 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-97b8479e-c70d-4b53-b8b8-ed3628c99ff2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:27.514993 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-50879f82-173d-4136-ab68-a9f2cf6baeaa tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1363 microversion: 2.1 time: 0.218008 Sep 06 22:43:27.515744 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 50/105] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:27 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:27.518391 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-97b8479e-c70d-4b53-b8b8-ed3628c99ff2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:27.520259 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-97b8479e-c70d-4b53-b8b8-ed3628c99ff2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:27.521425 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-97b8479e-c70d-4b53-b8b8-ed3628c99ff2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1407 microversion: 2.20 time: 0.215716 Sep 06 22:43:27.521971 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 56/106] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:43:27 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 22:43:28.054009 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c7a17568-43e4-47d0-a584-72c91ca87536 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:28.055687 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c7a17568-43e4-47d0-a584-72c91ca87536 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:28.058951 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d9c8b8ec-3219-49b9-9e17-36b3d71065bb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:28.059575 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-d9c8b8ec-3219-49b9-9e17-36b3d71065bb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:28.070185 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c7a17568-43e4-47d0-a584-72c91ca87536 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:28.072149 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c7a17568-43e4-47d0-a584-72c91ca87536 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:28.074346 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c7a17568-43e4-47d0-a584-72c91ca87536 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:28.076802 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c7a17568-43e4-47d0-a584-72c91ca87536 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:28.077725 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c7a17568-43e4-47d0-a584-72c91ca87536 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:28.078651 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d9c8b8ec-3219-49b9-9e17-36b3d71065bb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:28.079876 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d9c8b8ec-3219-49b9-9e17-36b3d71065bb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:28.080314 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d9c8b8ec-3219-49b9-9e17-36b3d71065bb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:28.080812 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c7a17568-43e4-47d0-a584-72c91ca87536 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:28.081049 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d9c8b8ec-3219-49b9-9e17-36b3d71065bb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:28.081502 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d9c8b8ec-3219-49b9-9e17-36b3d71065bb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:28.081922 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d9c8b8ec-3219-49b9-9e17-36b3d71065bb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:28.131455 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:43:29.307753 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c7a17568-43e4-47d0-a584-72c91ca87536 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5264060ddd48afa8305c38a9bfa4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f01bb55623a4bf580008b75a9715796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:29.336516 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c7a17568-43e4-47d0-a584-72c91ca87536 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291" status: 200 len: 1314 microversion: 2.1 time: 1.289088 Sep 06 22:43:29.337144 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 51/107] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:28 2022] GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 => generated 1314 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:29.340563 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-d9c8b8ec-3219-49b9-9e17-36b3d71065bb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:29.357566 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d9c8b8ec-3219-49b9-9e17-36b3d71065bb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1322 microversion: 2.1 time: 1.302354 Sep 06 22:43:29.358749 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 57/108] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:28 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1322 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:29.364597 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-eaa7b86d-d5d5-4c21-9647-8ed4a096cabe tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:29.365590 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-eaa7b86d-d5d5-4c21-9647-8ed4a096cabe tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:29.365851 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d76a3d4b-45e7-48ee-87ae-2d6854cb98ae tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:29.367363 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d76a3d4b-45e7-48ee-87ae-2d6854cb98ae tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:29.371970 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-eaa7b86d-d5d5-4c21-9647-8ed4a096cabe tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:29.372641 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-eaa7b86d-d5d5-4c21-9647-8ed4a096cabe tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:29.373346 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-eaa7b86d-d5d5-4c21-9647-8ed4a096cabe tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:29.374228 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-eaa7b86d-d5d5-4c21-9647-8ed4a096cabe tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:29.374547 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d76a3d4b-45e7-48ee-87ae-2d6854cb98ae tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:29.374990 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-eaa7b86d-d5d5-4c21-9647-8ed4a096cabe tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:29.375093 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d76a3d4b-45e7-48ee-87ae-2d6854cb98ae tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:29.375706 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d76a3d4b-45e7-48ee-87ae-2d6854cb98ae tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:29.376015 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-eaa7b86d-d5d5-4c21-9647-8ed4a096cabe tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:29.384481 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d76a3d4b-45e7-48ee-87ae-2d6854cb98ae tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:29.385020 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d76a3d4b-45e7-48ee-87ae-2d6854cb98ae tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:29.385467 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d76a3d4b-45e7-48ee-87ae-2d6854cb98ae tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:29.874818 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d76a3d4b-45e7-48ee-87ae-2d6854cb98ae tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:29.889354 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d76a3d4b-45e7-48ee-87ae-2d6854cb98ae tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1363 microversion: 2.1 time: 0.525362 Sep 06 22:43:29.889354 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 52/109] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:29 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1363 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:29.916350 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-eaa7b86d-d5d5-4c21-9647-8ed4a096cabe tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:29.929635 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-eaa7b86d-d5d5-4c21-9647-8ed4a096cabe tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:29.932459 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-eaa7b86d-d5d5-4c21-9647-8ed4a096cabe tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:29.934452 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-eaa7b86d-d5d5-4c21-9647-8ed4a096cabe tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1407 microversion: 2.20 time: 0.574359 Sep 06 22:43:29.936380 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 58/110] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:43:29 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1407 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:43:30.304246 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-7c3187fe-0081-4f62-9aef-79f5f9674a2d req-125af79a-87b4-4cfe-9314-73885843a50a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13ef5db2-b5d1-41af-8c93-2851abb0b6dd", "tag": "2130f481-0970-42ca-bbc5-20da06de6a04"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:43:30.326153 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-7c3187fe-0081-4f62-9aef-79f5f9674a2d req-125af79a-87b4-4cfe-9314-73885843a50a service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:30.326893 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-7c3187fe-0081-4f62-9aef-79f5f9674a2d req-125af79a-87b4-4cfe-9314-73885843a50a service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:30.341600 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-7c3187fe-0081-4f62-9aef-79f5f9674a2d req-125af79a-87b4-4cfe-9314-73885843a50a service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:30.363160 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-7c3187fe-0081-4f62-9aef-79f5f9674a2d req-125af79a-87b4-4cfe-9314-73885843a50a service nova] Creating event network-changed:2130f481-0970-42ca-bbc5-20da06de6a04 for instance 13ef5db2-b5d1-41af-8c93-2851abb0b6dd on hv-cinder-85220 Sep 06 22:43:30.365132 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-0735f935-79cb-4b01-9d97-27342c6be76b tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:30.365882 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-0735f935-79cb-4b01-9d97-27342c6be76b tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:30.371506 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-7c3187fe-0081-4f62-9aef-79f5f9674a2d req-125af79a-87b4-4cfe-9314-73885843a50a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070677 Sep 06 22:43:30.372391 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 53/111] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:43:30.378248 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0735f935-79cb-4b01-9d97-27342c6be76b tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:30.379381 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0735f935-79cb-4b01-9d97-27342c6be76b tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:30.379966 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0735f935-79cb-4b01-9d97-27342c6be76b tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:30.380896 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0735f935-79cb-4b01-9d97-27342c6be76b tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:30.381476 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0735f935-79cb-4b01-9d97-27342c6be76b tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:30.382095 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0735f935-79cb-4b01-9d97-27342c6be76b tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:30.391849 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-72bb9a6c-497f-4abc-8523-d343b5dbd45c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:30.392823 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-72bb9a6c-497f-4abc-8523-d343b5dbd45c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:30.401874 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-72bb9a6c-497f-4abc-8523-d343b5dbd45c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:30.402752 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-72bb9a6c-497f-4abc-8523-d343b5dbd45c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:30.404571 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-72bb9a6c-497f-4abc-8523-d343b5dbd45c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:30.406033 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-72bb9a6c-497f-4abc-8523-d343b5dbd45c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:30.406763 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-72bb9a6c-497f-4abc-8523-d343b5dbd45c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:30.408030 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-72bb9a6c-497f-4abc-8523-d343b5dbd45c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:30.642078 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-72bb9a6c-497f-4abc-8523-d343b5dbd45c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:30.649492 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-0735f935-79cb-4b01-9d97-27342c6be76b tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5264060ddd48afa8305c38a9bfa4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f01bb55623a4bf580008b75a9715796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:30.651032 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-72bb9a6c-497f-4abc-8523-d343b5dbd45c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1322 microversion: 2.1 time: 0.263627 Sep 06 22:43:30.654956 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 54/112] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:30 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1322 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:30.659026 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-0735f935-79cb-4b01-9d97-27342c6be76b tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291" status: 200 len: 1314 microversion: 2.1 time: 0.299244 Sep 06 22:43:30.659674 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 59/113] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:30 2022] GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:43:30.916817 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5ad4b1cb-e900-4b96-962e-1b34d549ba61 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:30.917669 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5ad4b1cb-e900-4b96-962e-1b34d549ba61 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:30.924546 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ad4b1cb-e900-4b96-962e-1b34d549ba61 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:30.925052 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ad4b1cb-e900-4b96-962e-1b34d549ba61 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:30.925655 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ad4b1cb-e900-4b96-962e-1b34d549ba61 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:30.926498 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ad4b1cb-e900-4b96-962e-1b34d549ba61 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:30.926945 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ad4b1cb-e900-4b96-962e-1b34d549ba61 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:30.927359 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ad4b1cb-e900-4b96-962e-1b34d549ba61 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:30.962162 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-aa7f276a-a160-4fae-8162-ee04aa82ecba tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:30.963450 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-aa7f276a-a160-4fae-8162-ee04aa82ecba tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:30.976270 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-aa7f276a-a160-4fae-8162-ee04aa82ecba tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:30.976904 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-aa7f276a-a160-4fae-8162-ee04aa82ecba tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:30.977479 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-aa7f276a-a160-4fae-8162-ee04aa82ecba tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:30.978370 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-aa7f276a-a160-4fae-8162-ee04aa82ecba tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:30.978985 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-aa7f276a-a160-4fae-8162-ee04aa82ecba tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:30.979386 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-aa7f276a-a160-4fae-8162-ee04aa82ecba tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:31.836961 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5ad4b1cb-e900-4b96-962e-1b34d549ba61 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:31.847786 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5ad4b1cb-e900-4b96-962e-1b34d549ba61 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1363 microversion: 2.1 time: 0.934851 Sep 06 22:43:31.861962 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 55/114] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:30 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1363 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:31.869428 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7fb212fb-cb78-411b-81a8-94b41211a293 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:31.870245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7fb212fb-cb78-411b-81a8-94b41211a293 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:31.879029 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7fb212fb-cb78-411b-81a8-94b41211a293 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:31.881800 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7fb212fb-cb78-411b-81a8-94b41211a293 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:31.883133 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7fb212fb-cb78-411b-81a8-94b41211a293 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:31.884021 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7fb212fb-cb78-411b-81a8-94b41211a293 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:31.885444 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7fb212fb-cb78-411b-81a8-94b41211a293 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:31.887238 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7fb212fb-cb78-411b-81a8-94b41211a293 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:31.956927 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-aa7f276a-a160-4fae-8162-ee04aa82ecba tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:31.974983 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-aa7f276a-a160-4fae-8162-ee04aa82ecba tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:31.977008 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-aa7f276a-a160-4fae-8162-ee04aa82ecba tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:31.978720 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-aa7f276a-a160-4fae-8162-ee04aa82ecba tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1407 microversion: 2.20 time: 1.020244 Sep 06 22:43:32.005146 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 60/115] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:43:30 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1407 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:43:32.023796 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ea42c158-972c-4a2b-91c8-bf23310104aa tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:32.025909 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ea42c158-972c-4a2b-91c8-bf23310104aa tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:32.042878 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ea42c158-972c-4a2b-91c8-bf23310104aa tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:32.043380 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ea42c158-972c-4a2b-91c8-bf23310104aa tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:32.043808 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ea42c158-972c-4a2b-91c8-bf23310104aa tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:32.044530 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ea42c158-972c-4a2b-91c8-bf23310104aa tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:32.045013 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ea42c158-972c-4a2b-91c8-bf23310104aa tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:32.045429 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ea42c158-972c-4a2b-91c8-bf23310104aa tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:32.446473 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ea42c158-972c-4a2b-91c8-bf23310104aa tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5264060ddd48afa8305c38a9bfa4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f01bb55623a4bf580008b75a9715796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:32.455395 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ea42c158-972c-4a2b-91c8-bf23310104aa tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291" status: 200 len: 1314 microversion: 2.1 time: 0.445994 Sep 06 22:43:32.464632 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7fb212fb-cb78-411b-81a8-94b41211a293 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:32.473276 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 61/116] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:32 2022] GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:32.474236 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7fb212fb-cb78-411b-81a8-94b41211a293 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1322 microversion: 2.1 time: 0.610850 Sep 06 22:43:32.475278 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 56/117] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:31 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1322 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:32.877004 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-5128d11f-891a-44b0-b71b-94c66989d974 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:32.878572 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-5128d11f-891a-44b0-b71b-94c66989d974 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:32.885753 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5128d11f-891a-44b0-b71b-94c66989d974 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:32.886617 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5128d11f-891a-44b0-b71b-94c66989d974 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:32.887327 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5128d11f-891a-44b0-b71b-94c66989d974 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:32.888866 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5128d11f-891a-44b0-b71b-94c66989d974 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:32.889528 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5128d11f-891a-44b0-b71b-94c66989d974 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:32.903363 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5128d11f-891a-44b0-b71b-94c66989d974 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:33.022483 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-97773ad5-fc54-4ca6-bdda-7af9afa52926 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:33.023717 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-97773ad5-fc54-4ca6-bdda-7af9afa52926 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:33.032263 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-97773ad5-fc54-4ca6-bdda-7af9afa52926 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:33.033370 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-97773ad5-fc54-4ca6-bdda-7af9afa52926 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:33.034247 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-97773ad5-fc54-4ca6-bdda-7af9afa52926 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:33.035378 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-97773ad5-fc54-4ca6-bdda-7af9afa52926 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:33.036027 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-97773ad5-fc54-4ca6-bdda-7af9afa52926 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:33.036447 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-97773ad5-fc54-4ca6-bdda-7af9afa52926 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:33.076225 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-5128d11f-891a-44b0-b71b-94c66989d974 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:33.087322 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-5128d11f-891a-44b0-b71b-94c66989d974 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1363 microversion: 2.1 time: 0.215628 Sep 06 22:43:33.105160 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 62/118] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:32 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:33.385121 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-97773ad5-fc54-4ca6-bdda-7af9afa52926 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:33.399642 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-97773ad5-fc54-4ca6-bdda-7af9afa52926 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:33.405007 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-97773ad5-fc54-4ca6-bdda-7af9afa52926 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:33.409852 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-97773ad5-fc54-4ca6-bdda-7af9afa52926 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1407 microversion: 2.20 time: 0.391725 Sep 06 22:43:33.411416 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 57/119] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:43:33 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1407 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 22:43:33.501441 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-89891168-b24d-469a-97fa-be7cf2d0fe79 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:33.501706 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e8be48a9-25f5-472d-8f3f-c45ed3b99426 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:33.502325 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-89891168-b24d-469a-97fa-be7cf2d0fe79 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:33.502969 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e8be48a9-25f5-472d-8f3f-c45ed3b99426 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:33.514029 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89891168-b24d-469a-97fa-be7cf2d0fe79 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:33.515562 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89891168-b24d-469a-97fa-be7cf2d0fe79 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:33.515668 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89891168-b24d-469a-97fa-be7cf2d0fe79 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:33.516507 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89891168-b24d-469a-97fa-be7cf2d0fe79 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:33.516981 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89891168-b24d-469a-97fa-be7cf2d0fe79 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:33.520489 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89891168-b24d-469a-97fa-be7cf2d0fe79 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:33.523502 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e8be48a9-25f5-472d-8f3f-c45ed3b99426 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:33.524202 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e8be48a9-25f5-472d-8f3f-c45ed3b99426 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:33.524862 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e8be48a9-25f5-472d-8f3f-c45ed3b99426 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:33.526058 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e8be48a9-25f5-472d-8f3f-c45ed3b99426 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:33.527062 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e8be48a9-25f5-472d-8f3f-c45ed3b99426 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:33.527691 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e8be48a9-25f5-472d-8f3f-c45ed3b99426 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:34.106257 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e8be48a9-25f5-472d-8f3f-c45ed3b99426 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5264060ddd48afa8305c38a9bfa4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f01bb55623a4bf580008b75a9715796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:34.120236 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e8be48a9-25f5-472d-8f3f-c45ed3b99426 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291" status: 200 len: 1314 microversion: 2.1 time: 0.625305 Sep 06 22:43:34.129282 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-89891168-b24d-469a-97fa-be7cf2d0fe79 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:34.133321 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 63/120] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:33 2022] GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 => generated 1314 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:34.139121 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-89891168-b24d-469a-97fa-be7cf2d0fe79 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1322 microversion: 2.1 time: 0.643474 Sep 06 22:43:34.141862 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 58/121] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:33 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1322 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:34.164157 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3d355243-9b98-45ce-b5a0-09cddb2bd5e6 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:34.165019 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3d355243-9b98-45ce-b5a0-09cddb2bd5e6 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:34.204694 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d355243-9b98-45ce-b5a0-09cddb2bd5e6 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:34.205605 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d355243-9b98-45ce-b5a0-09cddb2bd5e6 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:34.207463 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d355243-9b98-45ce-b5a0-09cddb2bd5e6 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:34.208695 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d355243-9b98-45ce-b5a0-09cddb2bd5e6 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:34.209357 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d355243-9b98-45ce-b5a0-09cddb2bd5e6 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:34.210545 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3d355243-9b98-45ce-b5a0-09cddb2bd5e6 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:34.355443 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-507ba04a-8e84-44ec-99be-80f60a4738e1 req-2f760ffd-49f3-4369-a18c-4a84dba48cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bcd7a9d-c2c8-489c-9827-b6be1508d63c", "name": "network-vif-plugged", "status": "completed", "tag": "20bc1f9d-50d4-4f0b-afe1-3cdbc5f69caa"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:43:34.371428 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-507ba04a-8e84-44ec-99be-80f60a4738e1 req-2f760ffd-49f3-4369-a18c-4a84dba48cc6 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:34.371952 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-507ba04a-8e84-44ec-99be-80f60a4738e1 req-2f760ffd-49f3-4369-a18c-4a84dba48cc6 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:34.377222 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-507ba04a-8e84-44ec-99be-80f60a4738e1 req-2f760ffd-49f3-4369-a18c-4a84dba48cc6 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:34.416665 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-507ba04a-8e84-44ec-99be-80f60a4738e1 req-2f760ffd-49f3-4369-a18c-4a84dba48cc6 service nova] Creating event network-vif-plugged:20bc1f9d-50d4-4f0b-afe1-3cdbc5f69caa for instance 5bcd7a9d-c2c8-489c-9827-b6be1508d63c on hv-cinder-85220 Sep 06 22:43:34.430834 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-507ba04a-8e84-44ec-99be-80f60a4738e1 req-2f760ffd-49f3-4369-a18c-4a84dba48cc6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.296032 Sep 06 22:43:34.431600 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 64/122] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:43:34.448044 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-85254624-8866-4dbd-b07e-b594b4d5fe6e tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:34.450486 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-85254624-8866-4dbd-b07e-b594b4d5fe6e tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:34.481319 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-85254624-8866-4dbd-b07e-b594b4d5fe6e tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:34.482194 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-85254624-8866-4dbd-b07e-b594b4d5fe6e tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:34.487050 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-85254624-8866-4dbd-b07e-b594b4d5fe6e tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:34.487926 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-85254624-8866-4dbd-b07e-b594b4d5fe6e tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:34.488386 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-85254624-8866-4dbd-b07e-b594b4d5fe6e tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:34.489323 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-85254624-8866-4dbd-b07e-b594b4d5fe6e tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:34.495236 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3d355243-9b98-45ce-b5a0-09cddb2bd5e6 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:34.506725 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3d355243-9b98-45ce-b5a0-09cddb2bd5e6 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1363 microversion: 2.1 time: 0.363422 Sep 06 22:43:34.508599 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 59/123] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:34 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1363 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:34.755101 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-85254624-8866-4dbd-b07e-b594b4d5fe6e tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:34.773588 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-85254624-8866-4dbd-b07e-b594b4d5fe6e tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:34.775558 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-85254624-8866-4dbd-b07e-b594b4d5fe6e tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:34.777264 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-85254624-8866-4dbd-b07e-b594b4d5fe6e tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1407 microversion: 2.20 time: 0.337567 Sep 06 22:43:34.778369 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 65/124] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:43:34 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1407 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:43:35.145048 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3765e24a-ac23-49a7-800f-bea8be86c368 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:35.146337 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3765e24a-ac23-49a7-800f-bea8be86c368 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:35.155111 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3765e24a-ac23-49a7-800f-bea8be86c368 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:35.156201 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3765e24a-ac23-49a7-800f-bea8be86c368 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:35.157203 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3765e24a-ac23-49a7-800f-bea8be86c368 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:35.157999 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3765e24a-ac23-49a7-800f-bea8be86c368 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:35.158567 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3765e24a-ac23-49a7-800f-bea8be86c368 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:35.159156 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3765e24a-ac23-49a7-800f-bea8be86c368 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:35.165213 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e07ea7ff-f046-4afa-b1b2-60bf5b454b90 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:35.165870 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e07ea7ff-f046-4afa-b1b2-60bf5b454b90 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:35.175283 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e07ea7ff-f046-4afa-b1b2-60bf5b454b90 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:35.175819 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e07ea7ff-f046-4afa-b1b2-60bf5b454b90 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:35.176922 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e07ea7ff-f046-4afa-b1b2-60bf5b454b90 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:35.179732 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e07ea7ff-f046-4afa-b1b2-60bf5b454b90 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:35.180622 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e07ea7ff-f046-4afa-b1b2-60bf5b454b90 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:35.181303 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e07ea7ff-f046-4afa-b1b2-60bf5b454b90 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:35.496812 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e07ea7ff-f046-4afa-b1b2-60bf5b454b90 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:35.505224 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e07ea7ff-f046-4afa-b1b2-60bf5b454b90 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1322 microversion: 2.1 time: 0.344188 Sep 06 22:43:35.517574 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 66/125] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:35 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1322 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:35.535572 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9be4615b-4675-4610-acc3-ec1c8660e93d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:35.536191 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9be4615b-4675-4610-acc3-ec1c8660e93d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:35.542576 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9be4615b-4675-4610-acc3-ec1c8660e93d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:35.543276 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9be4615b-4675-4610-acc3-ec1c8660e93d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:35.543873 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9be4615b-4675-4610-acc3-ec1c8660e93d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:35.544731 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9be4615b-4675-4610-acc3-ec1c8660e93d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:35.545659 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9be4615b-4675-4610-acc3-ec1c8660e93d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:35.546418 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9be4615b-4675-4610-acc3-ec1c8660e93d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:35.552579 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3765e24a-ac23-49a7-800f-bea8be86c368 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5264060ddd48afa8305c38a9bfa4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f01bb55623a4bf580008b75a9715796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:35.567321 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3765e24a-ac23-49a7-800f-bea8be86c368 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291" status: 200 len: 1314 microversion: 2.1 time: 0.426944 Sep 06 22:43:35.581263 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 60/126] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:35 2022] GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:35.781744 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9be4615b-4675-4610-acc3-ec1c8660e93d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:35.789521 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9be4615b-4675-4610-acc3-ec1c8660e93d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1363 microversion: 2.1 time: 0.260493 Sep 06 22:43:35.801252 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 67/127] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:35 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1363 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:35.806806 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6a2eea1b-58d3-4f5b-adc8-08d22acee116 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:35.807540 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6a2eea1b-58d3-4f5b-adc8-08d22acee116 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:35.814638 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a2eea1b-58d3-4f5b-adc8-08d22acee116 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:35.815117 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a2eea1b-58d3-4f5b-adc8-08d22acee116 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:35.815538 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a2eea1b-58d3-4f5b-adc8-08d22acee116 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:35.816255 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a2eea1b-58d3-4f5b-adc8-08d22acee116 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:35.816697 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a2eea1b-58d3-4f5b-adc8-08d22acee116 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:35.817134 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6a2eea1b-58d3-4f5b-adc8-08d22acee116 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:36.167972 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6a2eea1b-58d3-4f5b-adc8-08d22acee116 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:36.176474 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6a2eea1b-58d3-4f5b-adc8-08d22acee116 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:36.178020 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6a2eea1b-58d3-4f5b-adc8-08d22acee116 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:36.179176 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6a2eea1b-58d3-4f5b-adc8-08d22acee116 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1407 microversion: 2.20 time: 0.378645 Sep 06 22:43:36.179737 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 61/128] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:43:35 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1407 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:43:36.454204 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-5dafb4e0-41df-429d-b28d-3ebdf7d499a8 req-d892d409-af35-4b1f-8d0a-5ce813f858c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea64584-7d61-47f0-8296-25586329f9b5", "name": "network-vif-plugged", "status": "completed", "tag": "dad54419-8127-4e01-9006-f6c4183bdfa4"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:43:36.469914 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-5dafb4e0-41df-429d-b28d-3ebdf7d499a8 req-d892d409-af35-4b1f-8d0a-5ce813f858c0 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:36.475720 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-5dafb4e0-41df-429d-b28d-3ebdf7d499a8 req-d892d409-af35-4b1f-8d0a-5ce813f858c0 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:36.476287 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-5dafb4e0-41df-429d-b28d-3ebdf7d499a8 req-d892d409-af35-4b1f-8d0a-5ce813f858c0 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:36.488236 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-5dafb4e0-41df-429d-b28d-3ebdf7d499a8 req-d892d409-af35-4b1f-8d0a-5ce813f858c0 service nova] Creating event network-vif-plugged:dad54419-8127-4e01-9006-f6c4183bdfa4 for instance eea64584-7d61-47f0-8296-25586329f9b5 on hv-cinder-85220 Sep 06 22:43:36.493552 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-5dafb4e0-41df-429d-b28d-3ebdf7d499a8 req-d892d409-af35-4b1f-8d0a-5ce813f858c0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049480 Sep 06 22:43:36.494847 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 68/129] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:43:36.552676 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d9b895b6-46d5-4a6f-ad45-808a860e8bd0 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:36.554586 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d9b895b6-46d5-4a6f-ad45-808a860e8bd0 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:36.576195 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9b895b6-46d5-4a6f-ad45-808a860e8bd0 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:36.579781 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9b895b6-46d5-4a6f-ad45-808a860e8bd0 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:36.580282 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9b895b6-46d5-4a6f-ad45-808a860e8bd0 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:36.584039 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9b895b6-46d5-4a6f-ad45-808a860e8bd0 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:36.584697 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9b895b6-46d5-4a6f-ad45-808a860e8bd0 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:36.585325 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9b895b6-46d5-4a6f-ad45-808a860e8bd0 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:36.595036 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-cc1779a0-2e62-4c3b-8889-ae7924bb5773 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:36.595797 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-cc1779a0-2e62-4c3b-8889-ae7924bb5773 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:36.605533 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cc1779a0-2e62-4c3b-8889-ae7924bb5773 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:36.605962 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cc1779a0-2e62-4c3b-8889-ae7924bb5773 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:36.606401 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cc1779a0-2e62-4c3b-8889-ae7924bb5773 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:36.607103 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cc1779a0-2e62-4c3b-8889-ae7924bb5773 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:36.607556 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cc1779a0-2e62-4c3b-8889-ae7924bb5773 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:36.608185 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cc1779a0-2e62-4c3b-8889-ae7924bb5773 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:36.876545 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d9b895b6-46d5-4a6f-ad45-808a860e8bd0 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:36.881051 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-cc1779a0-2e62-4c3b-8889-ae7924bb5773 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5264060ddd48afa8305c38a9bfa4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f01bb55623a4bf580008b75a9715796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:36.889648 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-cc1779a0-2e62-4c3b-8889-ae7924bb5773 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291" status: 200 len: 1314 microversion: 2.1 time: 0.301537 Sep 06 22:43:36.889868 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d9b895b6-46d5-4a6f-ad45-808a860e8bd0 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1322 microversion: 2.1 time: 0.351552 Sep 06 22:43:36.891371 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 62/131] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:36 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1322 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:36.891499 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 69/131] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:36 2022] GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:36.896986 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-de34b343-1b8d-43f3-a658-80932d080aa6 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:36.897774 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-de34b343-1b8d-43f3-a658-80932d080aa6 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:36.909253 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-de34b343-1b8d-43f3-a658-80932d080aa6 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:36.912276 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-de34b343-1b8d-43f3-a658-80932d080aa6 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:36.913931 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-de34b343-1b8d-43f3-a658-80932d080aa6 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:36.916703 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-de34b343-1b8d-43f3-a658-80932d080aa6 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:36.917514 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-de34b343-1b8d-43f3-a658-80932d080aa6 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:36.918199 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-de34b343-1b8d-43f3-a658-80932d080aa6 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:36.928737 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=100 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:43:37.098985 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-de34b343-1b8d-43f3-a658-80932d080aa6 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:37.110203 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-de34b343-1b8d-43f3-a658-80932d080aa6 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1363 microversion: 2.1 time: 0.216887 Sep 06 22:43:37.124785 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 70/132] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:36 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:37.205207 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a9dcc95f-7c6d-46f6-bd68-5aab583533ad tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:37.209138 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a9dcc95f-7c6d-46f6-bd68-5aab583533ad tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:37.215436 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9dcc95f-7c6d-46f6-bd68-5aab583533ad tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:37.216073 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9dcc95f-7c6d-46f6-bd68-5aab583533ad tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:37.216461 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9dcc95f-7c6d-46f6-bd68-5aab583533ad tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:37.217956 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9dcc95f-7c6d-46f6-bd68-5aab583533ad tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:37.218681 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9dcc95f-7c6d-46f6-bd68-5aab583533ad tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:37.219713 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a9dcc95f-7c6d-46f6-bd68-5aab583533ad tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:37.367587 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a9dcc95f-7c6d-46f6-bd68-5aab583533ad tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:37.377599 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a9dcc95f-7c6d-46f6-bd68-5aab583533ad tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:37.379324 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a9dcc95f-7c6d-46f6-bd68-5aab583533ad tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:37.380716 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a9dcc95f-7c6d-46f6-bd68-5aab583533ad tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1407 microversion: 2.20 time: 0.181091 Sep 06 22:43:37.382092 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 63/133] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:43:37 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:43:37.915195 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-008568c2-6fd9-41be-a68d-406128355297 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:37.915802 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-008568c2-6fd9-41be-a68d-406128355297 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:37.923193 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-1ee3ee3e-8075-4855-9d2e-81c1c8c150e5 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:37.923817 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-1ee3ee3e-8075-4855-9d2e-81c1c8c150e5 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:37.929742 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1ee3ee3e-8075-4855-9d2e-81c1c8c150e5 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:37.930000 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-008568c2-6fd9-41be-a68d-406128355297 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:37.930507 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-008568c2-6fd9-41be-a68d-406128355297 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:37.930929 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-008568c2-6fd9-41be-a68d-406128355297 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:37.931191 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1ee3ee3e-8075-4855-9d2e-81c1c8c150e5 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:37.931625 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-008568c2-6fd9-41be-a68d-406128355297 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:37.932005 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1ee3ee3e-8075-4855-9d2e-81c1c8c150e5 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:37.932111 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-008568c2-6fd9-41be-a68d-406128355297 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:37.932476 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-008568c2-6fd9-41be-a68d-406128355297 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:37.933196 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1ee3ee3e-8075-4855-9d2e-81c1c8c150e5 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:37.933856 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1ee3ee3e-8075-4855-9d2e-81c1c8c150e5 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:37.934631 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1ee3ee3e-8075-4855-9d2e-81c1c8c150e5 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:38.139155 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-1ee3ee3e-8075-4855-9d2e-81c1c8c150e5 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5264060ddd48afa8305c38a9bfa4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f01bb55623a4bf580008b75a9715796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:38.150847 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-1ee3ee3e-8075-4855-9d2e-81c1c8c150e5 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291" status: 200 len: 1314 microversion: 2.1 time: 0.240430 Sep 06 22:43:38.164790 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-008568c2-6fd9-41be-a68d-406128355297 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:38.164790 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-008568c2-6fd9-41be-a68d-406128355297 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1322 microversion: 2.1 time: 0.250157 Sep 06 22:43:38.164790 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 64/134] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:37 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:38.167113 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 71/135] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:37 2022] GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:38.167834 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5ebee52e-69c5-43d0-8234-743565faa863 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:38.168635 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5ebee52e-69c5-43d0-8234-743565faa863 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:38.175045 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ebee52e-69c5-43d0-8234-743565faa863 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:38.175699 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ebee52e-69c5-43d0-8234-743565faa863 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:38.176288 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ebee52e-69c5-43d0-8234-743565faa863 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:38.177214 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ebee52e-69c5-43d0-8234-743565faa863 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:38.177837 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ebee52e-69c5-43d0-8234-743565faa863 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:38.178427 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ebee52e-69c5-43d0-8234-743565faa863 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:38.351424 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5ebee52e-69c5-43d0-8234-743565faa863 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:38.359392 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5ebee52e-69c5-43d0-8234-743565faa863 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1363 microversion: 2.1 time: 0.195166 Sep 06 22:43:38.361777 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 65/136] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:38 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:38.414950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e8262e1e-97c0-48e2-9fa1-4b0ea7665084 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:38.416381 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e8262e1e-97c0-48e2-9fa1-4b0ea7665084 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:38.424681 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e8262e1e-97c0-48e2-9fa1-4b0ea7665084 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:38.425369 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e8262e1e-97c0-48e2-9fa1-4b0ea7665084 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:38.426484 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e8262e1e-97c0-48e2-9fa1-4b0ea7665084 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:38.427339 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e8262e1e-97c0-48e2-9fa1-4b0ea7665084 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:38.447795 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e8262e1e-97c0-48e2-9fa1-4b0ea7665084 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:38.449988 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e8262e1e-97c0-48e2-9fa1-4b0ea7665084 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:38.523100 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-b82ca6b5-1d24-4fc4-8754-7d56929dde18 req-b6e65e71-88a2-45a0-8a10-da186e576a01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bd3f7df-0b7f-451c-b6ea-c91792e466e5", "name": "network-vif-plugged", "status": "completed", "tag": "ebeeb6bc-6ebd-470a-adfd-3cc33ae98d90"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:43:38.539946 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-b82ca6b5-1d24-4fc4-8754-7d56929dde18 req-b6e65e71-88a2-45a0-8a10-da186e576a01 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:38.541068 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-b82ca6b5-1d24-4fc4-8754-7d56929dde18 req-b6e65e71-88a2-45a0-8a10-da186e576a01 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:38.541643 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-b82ca6b5-1d24-4fc4-8754-7d56929dde18 req-b6e65e71-88a2-45a0-8a10-da186e576a01 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:38.564410 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-b82ca6b5-1d24-4fc4-8754-7d56929dde18 req-b6e65e71-88a2-45a0-8a10-da186e576a01 service nova] Creating event network-vif-plugged:ebeeb6bc-6ebd-470a-adfd-3cc33ae98d90 for instance 7bd3f7df-0b7f-451c-b6ea-c91792e466e5 on hv-cinder-85220 Sep 06 22:43:38.570941 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-b82ca6b5-1d24-4fc4-8754-7d56929dde18 req-b6e65e71-88a2-45a0-8a10-da186e576a01 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057781 Sep 06 22:43:38.578826 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 66/137] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:43:38.805138 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e8262e1e-97c0-48e2-9fa1-4b0ea7665084 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:38.821734 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e8262e1e-97c0-48e2-9fa1-4b0ea7665084 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:38.823937 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e8262e1e-97c0-48e2-9fa1-4b0ea7665084 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:38.825323 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e8262e1e-97c0-48e2-9fa1-4b0ea7665084 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1407 microversion: 2.20 time: 0.418243 Sep 06 22:43:38.837524 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 72/138] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:43:38 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1407 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:43:39.193064 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-269f0561-e0a1-43af-9941-19fa46535036 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:39.193698 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-269f0561-e0a1-43af-9941-19fa46535036 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:39.203753 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b9e2e725-0147-450c-acd8-4b31558efb04 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:39.207366 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b9e2e725-0147-450c-acd8-4b31558efb04 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:39.208677 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-269f0561-e0a1-43af-9941-19fa46535036 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:39.209230 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-269f0561-e0a1-43af-9941-19fa46535036 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:39.209829 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-269f0561-e0a1-43af-9941-19fa46535036 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:39.210538 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-269f0561-e0a1-43af-9941-19fa46535036 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:39.210992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-269f0561-e0a1-43af-9941-19fa46535036 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:39.211477 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-269f0561-e0a1-43af-9941-19fa46535036 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:39.224263 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b9e2e725-0147-450c-acd8-4b31558efb04 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:39.225023 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b9e2e725-0147-450c-acd8-4b31558efb04 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:39.225202 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b9e2e725-0147-450c-acd8-4b31558efb04 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:39.227228 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b9e2e725-0147-450c-acd8-4b31558efb04 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:39.230948 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b9e2e725-0147-450c-acd8-4b31558efb04 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:39.231985 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b9e2e725-0147-450c-acd8-4b31558efb04 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:39.541634 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b9e2e725-0147-450c-acd8-4b31558efb04 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5264060ddd48afa8305c38a9bfa4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f01bb55623a4bf580008b75a9715796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:39.549723 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-269f0561-e0a1-43af-9941-19fa46535036 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:39.551029 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b9e2e725-0147-450c-acd8-4b31558efb04 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291" status: 200 len: 1314 microversion: 2.1 time: 0.362681 Sep 06 22:43:39.551996 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 67/139] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:39 2022] GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:39.559598 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-269f0561-e0a1-43af-9941-19fa46535036 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1322 microversion: 2.1 time: 0.371305 Sep 06 22:43:39.560903 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 73/140] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:39 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1322 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:39.561590 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a27957db-45eb-426b-8ce5-1d9782961aab tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:39.562420 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a27957db-45eb-426b-8ce5-1d9782961aab tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:39.569336 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a27957db-45eb-426b-8ce5-1d9782961aab tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:39.570042 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a27957db-45eb-426b-8ce5-1d9782961aab tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:39.570656 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a27957db-45eb-426b-8ce5-1d9782961aab tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:39.571524 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a27957db-45eb-426b-8ce5-1d9782961aab tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:39.572142 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a27957db-45eb-426b-8ce5-1d9782961aab tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:39.572988 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a27957db-45eb-426b-8ce5-1d9782961aab tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:39.728546 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a27957db-45eb-426b-8ce5-1d9782961aab tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:39.747342 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a27957db-45eb-426b-8ce5-1d9782961aab tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1363 microversion: 2.1 time: 0.193209 Sep 06 22:43:39.748201 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 68/141] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:39 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:39.853612 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-5e470afb-f0c7-4abd-a07c-ef5a2b5957fa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:39.857033 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-5e470afb-f0c7-4abd-a07c-ef5a2b5957fa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:39.864201 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e470afb-f0c7-4abd-a07c-ef5a2b5957fa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:39.864927 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e470afb-f0c7-4abd-a07c-ef5a2b5957fa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:39.865587 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e470afb-f0c7-4abd-a07c-ef5a2b5957fa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:39.866275 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e470afb-f0c7-4abd-a07c-ef5a2b5957fa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:39.866720 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e470afb-f0c7-4abd-a07c-ef5a2b5957fa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:39.867132 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e470afb-f0c7-4abd-a07c-ef5a2b5957fa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:40.047245 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-5e470afb-f0c7-4abd-a07c-ef5a2b5957fa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:40.063214 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-5e470afb-f0c7-4abd-a07c-ef5a2b5957fa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:40.066979 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-5e470afb-f0c7-4abd-a07c-ef5a2b5957fa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:40.075133 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-5e470afb-f0c7-4abd-a07c-ef5a2b5957fa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1407 microversion: 2.20 time: 0.220426 Sep 06 22:43:40.076172 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 74/142] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:43:39 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:43:40.585359 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7fc741b5-92d7-45a5-936b-5a99eb69203d tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:40.588016 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-26b927bb-b424-4a2d-a293-e2fa6dc8fd27 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:40.589230 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7fc741b5-92d7-45a5-936b-5a99eb69203d tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:40.590901 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-26b927bb-b424-4a2d-a293-e2fa6dc8fd27 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:40.607369 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7fc741b5-92d7-45a5-936b-5a99eb69203d tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:40.609346 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-26b927bb-b424-4a2d-a293-e2fa6dc8fd27 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:40.611035 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7fc741b5-92d7-45a5-936b-5a99eb69203d tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:40.611731 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-26b927bb-b424-4a2d-a293-e2fa6dc8fd27 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:40.612749 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7fc741b5-92d7-45a5-936b-5a99eb69203d tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:40.613685 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7fc741b5-92d7-45a5-936b-5a99eb69203d tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:40.614534 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-26b927bb-b424-4a2d-a293-e2fa6dc8fd27 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:40.615711 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7fc741b5-92d7-45a5-936b-5a99eb69203d tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:40.616551 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-26b927bb-b424-4a2d-a293-e2fa6dc8fd27 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:40.619018 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7fc741b5-92d7-45a5-936b-5a99eb69203d tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:40.619369 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-26b927bb-b424-4a2d-a293-e2fa6dc8fd27 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:40.621172 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-26b927bb-b424-4a2d-a293-e2fa6dc8fd27 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:40.679650 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:43:41.085712 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7fc741b5-92d7-45a5-936b-5a99eb69203d tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5264060ddd48afa8305c38a9bfa4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f01bb55623a4bf580008b75a9715796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:41.098084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7fc741b5-92d7-45a5-936b-5a99eb69203d tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291" status: 200 len: 1314 microversion: 2.1 time: 0.520394 Sep 06 22:43:41.099008 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 69/143] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:40 2022] GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 => generated 1314 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:41.105489 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-26b927bb-b424-4a2d-a293-e2fa6dc8fd27 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:41.114912 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-28a5147b-e563-4b54-a360-798f312df2e4 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:41.115642 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-28a5147b-e563-4b54-a360-798f312df2e4 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:41.119314 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-26b927bb-b424-4a2d-a293-e2fa6dc8fd27 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1322 microversion: 2.1 time: 0.539489 Sep 06 22:43:41.119889 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 75/144] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:40 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1322 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:41.126478 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-20a4b18d-f908-4daa-9d7c-7e6369d0edd0 req-03c9bb04-b7c4-4cc4-9987-fc773d0d6e62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4694c0a1-7900-4032-9200-acd16f179291", "name": "network-vif-plugged", "status": "completed", "tag": "cc85e0fe-203e-42a2-8387-fa852cacaca4"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:43:41.136114 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-28a5147b-e563-4b54-a360-798f312df2e4 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:41.136715 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-28a5147b-e563-4b54-a360-798f312df2e4 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:41.138364 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-28a5147b-e563-4b54-a360-798f312df2e4 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:41.139080 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-28a5147b-e563-4b54-a360-798f312df2e4 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:41.139534 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-28a5147b-e563-4b54-a360-798f312df2e4 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:41.139962 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-28a5147b-e563-4b54-a360-798f312df2e4 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:41.150456 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-20a4b18d-f908-4daa-9d7c-7e6369d0edd0 req-03c9bb04-b7c4-4cc4-9987-fc773d0d6e62 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:41.150763 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-20a4b18d-f908-4daa-9d7c-7e6369d0edd0 req-03c9bb04-b7c4-4cc4-9987-fc773d0d6e62 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:41.151186 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-20a4b18d-f908-4daa-9d7c-7e6369d0edd0 req-03c9bb04-b7c4-4cc4-9987-fc773d0d6e62 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:41.174315 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-20a4b18d-f908-4daa-9d7c-7e6369d0edd0 req-03c9bb04-b7c4-4cc4-9987-fc773d0d6e62 service nova] Creating event network-vif-plugged:cc85e0fe-203e-42a2-8387-fa852cacaca4 for instance 4694c0a1-7900-4032-9200-acd16f179291 on hv-cinder-85220 Sep 06 22:43:41.192538 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-20a4b18d-f908-4daa-9d7c-7e6369d0edd0 req-03c9bb04-b7c4-4cc4-9987-fc773d0d6e62 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071092 Sep 06 22:43:41.193679 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 76/145] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:43:41.199924 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-0921b46d-bb5f-4f10-8e90-ea6914fbe7df tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:41.202167 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-0921b46d-bb5f-4f10-8e90-ea6914fbe7df tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:41.238836 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0921b46d-bb5f-4f10-8e90-ea6914fbe7df tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:41.239359 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0921b46d-bb5f-4f10-8e90-ea6914fbe7df tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:41.239809 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0921b46d-bb5f-4f10-8e90-ea6914fbe7df tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:41.240510 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0921b46d-bb5f-4f10-8e90-ea6914fbe7df tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:41.240990 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0921b46d-bb5f-4f10-8e90-ea6914fbe7df tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:41.241633 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0921b46d-bb5f-4f10-8e90-ea6914fbe7df tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:41.430096 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-28a5147b-e563-4b54-a360-798f312df2e4 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:41.450635 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-28a5147b-e563-4b54-a360-798f312df2e4 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1363 microversion: 2.1 time: 0.350006 Sep 06 22:43:41.465716 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 70/146] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:41 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1363 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:41.478220 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-0921b46d-bb5f-4f10-8e90-ea6914fbe7df tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:41.501597 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-0921b46d-bb5f-4f10-8e90-ea6914fbe7df tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:41.501597 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-0921b46d-bb5f-4f10-8e90-ea6914fbe7df tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:41.501597 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-0921b46d-bb5f-4f10-8e90-ea6914fbe7df tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1407 microversion: 2.20 time: 0.302085 Sep 06 22:43:41.505211 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 77/147] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:43:41 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1407 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:43:42.123786 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5e4b22ed-1321-4d0a-a376-8346a6f2c798 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:42.124846 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5e4b22ed-1321-4d0a-a376-8346a6f2c798 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:42.131923 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e4b22ed-1321-4d0a-a376-8346a6f2c798 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:42.133019 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e4b22ed-1321-4d0a-a376-8346a6f2c798 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:42.133933 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e4b22ed-1321-4d0a-a376-8346a6f2c798 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:42.135102 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e4b22ed-1321-4d0a-a376-8346a6f2c798 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:42.135845 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e4b22ed-1321-4d0a-a376-8346a6f2c798 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:42.136741 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e4b22ed-1321-4d0a-a376-8346a6f2c798 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:42.147296 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-97fac694-fe80-4da0-b46f-4e926a40a8fd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:42.148346 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-97fac694-fe80-4da0-b46f-4e926a40a8fd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:42.160472 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-97fac694-fe80-4da0-b46f-4e926a40a8fd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:42.161622 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-97fac694-fe80-4da0-b46f-4e926a40a8fd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:42.162599 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-97fac694-fe80-4da0-b46f-4e926a40a8fd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:42.163930 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-97fac694-fe80-4da0-b46f-4e926a40a8fd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:42.164666 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-97fac694-fe80-4da0-b46f-4e926a40a8fd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:42.165376 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-97fac694-fe80-4da0-b46f-4e926a40a8fd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:42.454746 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5e4b22ed-1321-4d0a-a376-8346a6f2c798 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5264060ddd48afa8305c38a9bfa4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f01bb55623a4bf580008b75a9715796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:42.468526 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5e4b22ed-1321-4d0a-a376-8346a6f2c798 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291" status: 200 len: 1314 microversion: 2.1 time: 0.350486 Sep 06 22:43:42.470588 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 71/148] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:42 2022] GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:42.490831 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0f96fe54-0e72-4fe9-a7eb-a27eb74ee54e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:42.491431 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0f96fe54-0e72-4fe9-a7eb-a27eb74ee54e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:42.504473 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0f96fe54-0e72-4fe9-a7eb-a27eb74ee54e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:42.505148 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0f96fe54-0e72-4fe9-a7eb-a27eb74ee54e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:42.505752 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0f96fe54-0e72-4fe9-a7eb-a27eb74ee54e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:42.506604 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0f96fe54-0e72-4fe9-a7eb-a27eb74ee54e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:42.507057 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0f96fe54-0e72-4fe9-a7eb-a27eb74ee54e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:42.507472 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0f96fe54-0e72-4fe9-a7eb-a27eb74ee54e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:42.533685 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-97fac694-fe80-4da0-b46f-4e926a40a8fd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:42.569772 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-97fac694-fe80-4da0-b46f-4e926a40a8fd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1517 microversion: 2.1 time: 0.430225 Sep 06 22:43:42.578112 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 78/149] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:42 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1517 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:42.591992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6dbd233e-1cf8-4667-a47e-e227f323ac86 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:42.595600 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-6dbd233e-1cf8-4667-a47e-e227f323ac86 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:42.609357 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6dbd233e-1cf8-4667-a47e-e227f323ac86 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:42.615223 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6dbd233e-1cf8-4667-a47e-e227f323ac86 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:42.615865 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6dbd233e-1cf8-4667-a47e-e227f323ac86 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:42.616784 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6dbd233e-1cf8-4667-a47e-e227f323ac86 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:42.620175 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6dbd233e-1cf8-4667-a47e-e227f323ac86 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:42.621084 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6dbd233e-1cf8-4667-a47e-e227f323ac86 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:42.868412 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0f96fe54-0e72-4fe9-a7eb-a27eb74ee54e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:42.882536 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0f96fe54-0e72-4fe9-a7eb-a27eb74ee54e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1549 microversion: 2.1 time: 0.391516 Sep 06 22:43:42.897321 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6dbd233e-1cf8-4667-a47e-e227f323ac86 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:42.898214 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 72/150] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:42 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1549 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:42.914165 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-dd8226b5-bb85-4ada-b70a-3a90b164f120 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:43:42.914502 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6dbd233e-1cf8-4667-a47e-e227f323ac86 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:42.917680 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-dd8226b5-bb85-4ada-b70a-3a90b164f120 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:42.926449 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6dbd233e-1cf8-4667-a47e-e227f323ac86 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:42.928376 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dd8226b5-bb85-4ada-b70a-3a90b164f120 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:42.929210 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dd8226b5-bb85-4ada-b70a-3a90b164f120 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:42.929983 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dd8226b5-bb85-4ada-b70a-3a90b164f120 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:42.933209 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dd8226b5-bb85-4ada-b70a-3a90b164f120 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:42.934064 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dd8226b5-bb85-4ada-b70a-3a90b164f120 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:42.934697 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dd8226b5-bb85-4ada-b70a-3a90b164f120 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:42.942071 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-6dbd233e-1cf8-4667-a47e-e227f323ac86 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1407 microversion: 2.20 time: 0.360450 Sep 06 22:43:42.952819 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 79/151] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:43:42 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1407 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:43:42.952819 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f863f9f7-6f8e-48a4-ae08-f46757c50843 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:42.952819 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-f863f9f7-6f8e-48a4-ae08-f46757c50843 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:42.966575 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f863f9f7-6f8e-48a4-ae08-f46757c50843 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:42.967458 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f863f9f7-6f8e-48a4-ae08-f46757c50843 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:42.967939 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f863f9f7-6f8e-48a4-ae08-f46757c50843 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:42.975850 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f863f9f7-6f8e-48a4-ae08-f46757c50843 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:42.977198 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f863f9f7-6f8e-48a4-ae08-f46757c50843 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:42.977340 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f863f9f7-6f8e-48a4-ae08-f46757c50843 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:43.046966 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-dd8226b5-bb85-4ada-b70a-3a90b164f120 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lazy-loading 'flavor' on Instance uuid eea64584-7d61-47f0-8296-25586329f9b5 {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 22:43:43.200866 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-dd8226b5-bb85-4ada-b70a-3a90b164f120 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "POST /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5/action" status: 200 len: 32 microversion: 2.1 time: 0.300911 Sep 06 22:43:43.207679 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 73/152] 10.222.0.39 () {60 vars in 1278 bytes} [Tue Sep 6 22:43:42 2022] POST /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5/action => generated 32 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 22:43:43.216362 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-154b1d5c-ff0a-46d0-b7c3-1e90bebaaa38 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:43.217093 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-154b1d5c-ff0a-46d0-b7c3-1e90bebaaa38 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:43.224296 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-154b1d5c-ff0a-46d0-b7c3-1e90bebaaa38 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:43.225082 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-154b1d5c-ff0a-46d0-b7c3-1e90bebaaa38 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:43.225743 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-154b1d5c-ff0a-46d0-b7c3-1e90bebaaa38 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:43.226631 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-154b1d5c-ff0a-46d0-b7c3-1e90bebaaa38 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:43.227543 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-154b1d5c-ff0a-46d0-b7c3-1e90bebaaa38 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:43.227973 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-154b1d5c-ff0a-46d0-b7c3-1e90bebaaa38 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:43.265150 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-f863f9f7-6f8e-48a4-ae08-f46757c50843 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.321383 Sep 06 22:43:43.267316 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 80/153] 10.222.0.39 () {58 vars in 1275 bytes} [Tue Sep 6 22:43:42 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5/os-interface => generated 285 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:43:43.272388 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-478d0d22-2539-402b-8bb1-d5854c7ecebb req-1714aa5c-5df3-4008-9860-3890604d4b8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13ef5db2-b5d1-41af-8c93-2851abb0b6dd", "name": "network-vif-plugged", "status": "completed", "tag": "2130f481-0970-42ca-bbc5-20da06de6a04"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:43:43.304879 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-478d0d22-2539-402b-8bb1-d5854c7ecebb req-1714aa5c-5df3-4008-9860-3890604d4b8f service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:43.306704 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-478d0d22-2539-402b-8bb1-d5854c7ecebb req-1714aa5c-5df3-4008-9860-3890604d4b8f service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:43.308918 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-478d0d22-2539-402b-8bb1-d5854c7ecebb req-1714aa5c-5df3-4008-9860-3890604d4b8f service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:43.346985 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-478d0d22-2539-402b-8bb1-d5854c7ecebb req-1714aa5c-5df3-4008-9860-3890604d4b8f service nova] Creating event network-vif-plugged:2130f481-0970-42ca-bbc5-20da06de6a04 for instance 13ef5db2-b5d1-41af-8c93-2851abb0b6dd on hv-cinder-85220 Sep 06 22:43:43.352485 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-478d0d22-2539-402b-8bb1-d5854c7ecebb req-1714aa5c-5df3-4008-9860-3890604d4b8f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083813 Sep 06 22:43:43.353658 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 81/154] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:43:43.498268 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-97107e98-3340-46d1-b8c9-27034d0e01f6 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:43.504383 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-97107e98-3340-46d1-b8c9-27034d0e01f6 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:43.516424 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-97107e98-3340-46d1-b8c9-27034d0e01f6 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:43.517561 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-97107e98-3340-46d1-b8c9-27034d0e01f6 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:43.519139 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-97107e98-3340-46d1-b8c9-27034d0e01f6 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:43.520108 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-97107e98-3340-46d1-b8c9-27034d0e01f6 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:43.520869 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-97107e98-3340-46d1-b8c9-27034d0e01f6 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:43.521716 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-97107e98-3340-46d1-b8c9-27034d0e01f6 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:43.722388 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-154b1d5c-ff0a-46d0-b7c3-1e90bebaaa38 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:43.733960 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-154b1d5c-ff0a-46d0-b7c3-1e90bebaaa38 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1523 microversion: 2.1 time: 0.523981 Sep 06 22:43:43.735007 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 74/155] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:43 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1523 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:43.967726 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-60569c59-676c-43d4-b4b4-e60af358f672 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:43.968199 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-60569c59-676c-43d4-b4b4-e60af358f672 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:43.975061 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-60569c59-676c-43d4-b4b4-e60af358f672 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:43.975889 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-60569c59-676c-43d4-b4b4-e60af358f672 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:43.976553 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-60569c59-676c-43d4-b4b4-e60af358f672 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:43.977545 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-60569c59-676c-43d4-b4b4-e60af358f672 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:43.978061 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-60569c59-676c-43d4-b4b4-e60af358f672 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:43.978480 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-60569c59-676c-43d4-b4b4-e60af358f672 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:44.006659 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-97107e98-3340-46d1-b8c9-27034d0e01f6 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5264060ddd48afa8305c38a9bfa4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f01bb55623a4bf580008b75a9715796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:44.017044 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-97107e98-3340-46d1-b8c9-27034d0e01f6 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291" status: 200 len: 1314 microversion: 2.1 time: 0.525186 Sep 06 22:43:44.018363 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 82/156] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:43 2022] GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 => generated 1314 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:43:44.233867 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-60569c59-676c-43d4-b4b4-e60af358f672 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:44.311352 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-60569c59-676c-43d4-b4b4-e60af358f672 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:44.313748 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-60569c59-676c-43d4-b4b4-e60af358f672 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:44.315053 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-60569c59-676c-43d4-b4b4-e60af358f672 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1407 microversion: 2.20 time: 0.351344 Sep 06 22:43:44.315777 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 75/157] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:43:43 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1407 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 22:43:44.758543 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-c37bd60c-8acb-4aa0-9bcf-a00d18b02b14 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:44.759225 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-c37bd60c-8acb-4aa0-9bcf-a00d18b02b14 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:44.767922 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c37bd60c-8acb-4aa0-9bcf-a00d18b02b14 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:44.768654 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c37bd60c-8acb-4aa0-9bcf-a00d18b02b14 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:44.769529 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c37bd60c-8acb-4aa0-9bcf-a00d18b02b14 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:44.770262 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c37bd60c-8acb-4aa0-9bcf-a00d18b02b14 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:44.770978 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c37bd60c-8acb-4aa0-9bcf-a00d18b02b14 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:44.771685 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c37bd60c-8acb-4aa0-9bcf-a00d18b02b14 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:45.005953 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-c37bd60c-8acb-4aa0-9bcf-a00d18b02b14 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:45.017709 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-c37bd60c-8acb-4aa0-9bcf-a00d18b02b14 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1523 microversion: 2.1 time: 0.262310 Sep 06 22:43:45.033604 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 83/158] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:44 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1523 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:45.041191 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-394b72d3-9c7d-4cce-98dc-e856974b5bc1 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:45.041876 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-394b72d3-9c7d-4cce-98dc-e856974b5bc1 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:45.048488 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-394b72d3-9c7d-4cce-98dc-e856974b5bc1 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:45.049051 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-394b72d3-9c7d-4cce-98dc-e856974b5bc1 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:45.049700 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-394b72d3-9c7d-4cce-98dc-e856974b5bc1 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:45.050376 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-394b72d3-9c7d-4cce-98dc-e856974b5bc1 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:45.050818 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-394b72d3-9c7d-4cce-98dc-e856974b5bc1 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:45.051229 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-394b72d3-9c7d-4cce-98dc-e856974b5bc1 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:45.217235 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-394b72d3-9c7d-4cce-98dc-e856974b5bc1 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5264060ddd48afa8305c38a9bfa4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f01bb55623a4bf580008b75a9715796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:45.227176 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-394b72d3-9c7d-4cce-98dc-e856974b5bc1 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291" status: 200 len: 1500 microversion: 2.1 time: 0.189791 Sep 06 22:43:45.228369 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 76/159] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:45 2022] GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 => generated 1500 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:45.344299 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-7a474479-26e0-477d-b399-9a187bce0b58 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:45.344992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-7a474479-26e0-477d-b399-9a187bce0b58 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:45.357971 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7a474479-26e0-477d-b399-9a187bce0b58 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:45.358460 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7a474479-26e0-477d-b399-9a187bce0b58 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:45.358887 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7a474479-26e0-477d-b399-9a187bce0b58 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:45.360131 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7a474479-26e0-477d-b399-9a187bce0b58 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:45.360588 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7a474479-26e0-477d-b399-9a187bce0b58 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:45.374595 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7a474479-26e0-477d-b399-9a187bce0b58 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:45.534620 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-dfac6c7e-e16a-42ce-812a-7ddff3cfb730 req-7de8c216-31c3-4805-ae0c-e49a1007b7f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bd3f7df-0b7f-451c-b6ea-c91792e466e5", "tag": "ebeeb6bc-6ebd-470a-adfd-3cc33ae98d90"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:43:45.540424 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=91 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:43:45.549866 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-dfac6c7e-e16a-42ce-812a-7ddff3cfb730 req-7de8c216-31c3-4805-ae0c-e49a1007b7f6 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:45.552194 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-dfac6c7e-e16a-42ce-812a-7ddff3cfb730 req-7de8c216-31c3-4805-ae0c-e49a1007b7f6 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:45.553779 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-dfac6c7e-e16a-42ce-812a-7ddff3cfb730 req-7de8c216-31c3-4805-ae0c-e49a1007b7f6 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:45.569785 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-dfac6c7e-e16a-42ce-812a-7ddff3cfb730 req-7de8c216-31c3-4805-ae0c-e49a1007b7f6 service nova] Creating event network-changed:ebeeb6bc-6ebd-470a-adfd-3cc33ae98d90 for instance 7bd3f7df-0b7f-451c-b6ea-c91792e466e5 on hv-cinder-85220 Sep 06 22:43:45.591454 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-dfac6c7e-e16a-42ce-812a-7ddff3cfb730 req-7de8c216-31c3-4805-ae0c-e49a1007b7f6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061050 Sep 06 22:43:45.597283 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 77/160] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 22:43:45.907959 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-7a474479-26e0-477d-b399-9a187bce0b58 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:45.924473 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-7a474479-26e0-477d-b399-9a187bce0b58 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:45.926006 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-7a474479-26e0-477d-b399-9a187bce0b58 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:45.927197 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-7a474479-26e0-477d-b399-9a187bce0b58 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1407 microversion: 2.20 time: 0.588399 Sep 06 22:43:45.927792 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 84/161] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:43:45 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1407 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:43:46.043973 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f31b0939-be7e-415c-926b-58c66ea76b36 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:46.045056 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f31b0939-be7e-415c-926b-58c66ea76b36 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:46.059145 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f31b0939-be7e-415c-926b-58c66ea76b36 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:46.060126 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f31b0939-be7e-415c-926b-58c66ea76b36 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:46.064136 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f31b0939-be7e-415c-926b-58c66ea76b36 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:46.065178 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f31b0939-be7e-415c-926b-58c66ea76b36 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:46.065930 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f31b0939-be7e-415c-926b-58c66ea76b36 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:46.066647 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f31b0939-be7e-415c-926b-58c66ea76b36 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:46.380310 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f31b0939-be7e-415c-926b-58c66ea76b36 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:46.392852 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f31b0939-be7e-415c-926b-58c66ea76b36 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1523 microversion: 2.1 time: 0.353239 Sep 06 22:43:46.395225 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 78/162] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:46 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1523 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:46.959631 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-fa0a3ab2-492a-40b5-abdd-def0393f9721 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:46.961618 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-fa0a3ab2-492a-40b5-abdd-def0393f9721 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:46.964607 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=89 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:43:46.977998 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fa0a3ab2-492a-40b5-abdd-def0393f9721 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:46.978844 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fa0a3ab2-492a-40b5-abdd-def0393f9721 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:46.979832 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fa0a3ab2-492a-40b5-abdd-def0393f9721 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:46.981754 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fa0a3ab2-492a-40b5-abdd-def0393f9721 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:46.983851 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fa0a3ab2-492a-40b5-abdd-def0393f9721 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:46.985424 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fa0a3ab2-492a-40b5-abdd-def0393f9721 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:47.007309 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0e4c8b12-ecf1-4f5b-89ea-7209d97f7ee5 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "42fcd1ff-b8ea-4e0c-9219-b706877f9417"}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:43:47.010338 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0e4c8b12-ecf1-4f5b-89ea-7209d97f7ee5 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:47.018575 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0e4c8b12-ecf1-4f5b-89ea-7209d97f7ee5 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:47.019575 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0e4c8b12-ecf1-4f5b-89ea-7209d97f7ee5 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:47.020893 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0e4c8b12-ecf1-4f5b-89ea-7209d97f7ee5 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:47.022244 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0e4c8b12-ecf1-4f5b-89ea-7209d97f7ee5 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:47.023580 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0e4c8b12-ecf1-4f5b-89ea-7209d97f7ee5 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:47.024221 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0e4c8b12-ecf1-4f5b-89ea-7209d97f7ee5 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:47.330146 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-fa0a3ab2-492a-40b5-abdd-def0393f9721 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:47.356642 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-fa0a3ab2-492a-40b5-abdd-def0393f9721 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:47.358118 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-fa0a3ab2-492a-40b5-abdd-def0393f9721 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:47.359264 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-fa0a3ab2-492a-40b5-abdd-def0393f9721 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1599 microversion: 2.20 time: 0.403642 Sep 06 22:43:47.363192 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 85/163] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:43:46 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1599 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:43:47.404031 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-8ac84d66-7b3b-4beb-af66-6e3fa312c91b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:47.404626 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-8ac84d66-7b3b-4beb-af66-6e3fa312c91b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:47.421396 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8ac84d66-7b3b-4beb-af66-6e3fa312c91b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:47.424010 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8ac84d66-7b3b-4beb-af66-6e3fa312c91b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:47.425055 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8ac84d66-7b3b-4beb-af66-6e3fa312c91b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:47.426206 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8ac84d66-7b3b-4beb-af66-6e3fa312c91b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:47.426671 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8ac84d66-7b3b-4beb-af66-6e3fa312c91b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:47.427422 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8ac84d66-7b3b-4beb-af66-6e3fa312c91b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:47.577668 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-8ac84d66-7b3b-4beb-af66-6e3fa312c91b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.186355 Sep 06 22:43:47.578305 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 86/164] 10.222.0.39 () {60 vars in 1316 bytes} [Tue Sep 6 22:43:47 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd/os-interface => generated 284 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 22:43:47.584118 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-24a12eb4-71f6-4f02-b798-83de32697af9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:47.584724 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-24a12eb4-71f6-4f02-b798-83de32697af9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:47.601004 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-24a12eb4-71f6-4f02-b798-83de32697af9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:47.604015 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-24a12eb4-71f6-4f02-b798-83de32697af9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:47.604995 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-24a12eb4-71f6-4f02-b798-83de32697af9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:47.607265 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-24a12eb4-71f6-4f02-b798-83de32697af9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:47.608451 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-24a12eb4-71f6-4f02-b798-83de32697af9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:47.610432 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-24a12eb4-71f6-4f02-b798-83de32697af9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:47.628673 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0e4c8b12-ecf1-4f5b-89ea-7209d97f7ee5 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "POST /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.625122 Sep 06 22:43:47.630518 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 79/165] 10.222.0.39 () {60 vars in 1323 bytes} [Tue Sep 6 22:43:47 2022] POST /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291/os-volume_attachments => generated 194 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:43:47.862905 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-24a12eb4-71f6-4f02-b798-83de32697af9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:47.873077 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-24a12eb4-71f6-4f02-b798-83de32697af9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1523 microversion: 2.1 time: 0.293224 Sep 06 22:43:47.874373 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 87/166] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:47 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1523 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:48.898561 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-532fc73d-39ae-4058-b006-1a5f7dc92813 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:48.900025 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-532fc73d-39ae-4058-b006-1a5f7dc92813 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:48.916424 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-532fc73d-39ae-4058-b006-1a5f7dc92813 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:48.917129 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-532fc73d-39ae-4058-b006-1a5f7dc92813 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:48.917721 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-532fc73d-39ae-4058-b006-1a5f7dc92813 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:48.918574 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-532fc73d-39ae-4058-b006-1a5f7dc92813 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:48.919159 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-532fc73d-39ae-4058-b006-1a5f7dc92813 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:48.919734 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-532fc73d-39ae-4058-b006-1a5f7dc92813 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:49.067829 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-c6f96b64-bf9c-47c0-a286-271efbda1271 req-dcf3e0a2-690f-4ddb-bd73-21f6f9c370d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13ef5db2-b5d1-41af-8c93-2851abb0b6dd", "tag": "2130f481-0970-42ca-bbc5-20da06de6a04"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:43:49.077746 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-c6f96b64-bf9c-47c0-a286-271efbda1271 req-dcf3e0a2-690f-4ddb-bd73-21f6f9c370d5 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:49.079221 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-c6f96b64-bf9c-47c0-a286-271efbda1271 req-dcf3e0a2-690f-4ddb-bd73-21f6f9c370d5 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:49.079792 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-c6f96b64-bf9c-47c0-a286-271efbda1271 req-dcf3e0a2-690f-4ddb-bd73-21f6f9c370d5 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:49.092273 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-c6f96b64-bf9c-47c0-a286-271efbda1271 req-dcf3e0a2-690f-4ddb-bd73-21f6f9c370d5 service nova] Creating event network-changed:2130f481-0970-42ca-bbc5-20da06de6a04 for instance 13ef5db2-b5d1-41af-8c93-2851abb0b6dd on hv-cinder-85220 Sep 06 22:43:49.098832 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-c6f96b64-bf9c-47c0-a286-271efbda1271 req-dcf3e0a2-690f-4ddb-bd73-21f6f9c370d5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034363 Sep 06 22:43:49.105159 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 88/167] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:43:49.151657 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-532fc73d-39ae-4058-b006-1a5f7dc92813 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:49.166747 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-532fc73d-39ae-4058-b006-1a5f7dc92813 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1523 microversion: 2.1 time: 0.273384 Sep 06 22:43:49.167850 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 80/168] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:48 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1523 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:50.192734 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-09121b8e-a30f-4785-8f3c-e19d34846d1e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:50.193605 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-09121b8e-a30f-4785-8f3c-e19d34846d1e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:50.221335 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-09121b8e-a30f-4785-8f3c-e19d34846d1e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:50.223706 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-09121b8e-a30f-4785-8f3c-e19d34846d1e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:50.224621 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-09121b8e-a30f-4785-8f3c-e19d34846d1e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:50.226680 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-09121b8e-a30f-4785-8f3c-e19d34846d1e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:50.227322 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-09121b8e-a30f-4785-8f3c-e19d34846d1e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:50.227955 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-09121b8e-a30f-4785-8f3c-e19d34846d1e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:50.258647 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=100 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:43:50.431120 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-09121b8e-a30f-4785-8f3c-e19d34846d1e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:50.439560 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-09121b8e-a30f-4785-8f3c-e19d34846d1e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1523 microversion: 2.1 time: 0.252367 Sep 06 22:43:50.440384 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 89/169] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:50 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1523 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:51.465489 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fc1ba457-c7f0-4bf0-8855-f0d23c36c4e4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:51.466086 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fc1ba457-c7f0-4bf0-8855-f0d23c36c4e4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:51.473566 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fc1ba457-c7f0-4bf0-8855-f0d23c36c4e4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:51.474289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fc1ba457-c7f0-4bf0-8855-f0d23c36c4e4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:51.474729 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fc1ba457-c7f0-4bf0-8855-f0d23c36c4e4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:51.475412 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fc1ba457-c7f0-4bf0-8855-f0d23c36c4e4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:51.475887 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fc1ba457-c7f0-4bf0-8855-f0d23c36c4e4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:51.476300 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fc1ba457-c7f0-4bf0-8855-f0d23c36c4e4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:51.631871 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fc1ba457-c7f0-4bf0-8855-f0d23c36c4e4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:51.642117 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fc1ba457-c7f0-4bf0-8855-f0d23c36c4e4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1523 microversion: 2.1 time: 0.180846 Sep 06 22:43:51.642702 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 81/170] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:51 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:52.667122 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-79dd2647-aa81-4624-a7c1-8a4ba27ee14b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:52.667937 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-79dd2647-aa81-4624-a7c1-8a4ba27ee14b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:52.675559 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-79dd2647-aa81-4624-a7c1-8a4ba27ee14b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:52.676964 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-79dd2647-aa81-4624-a7c1-8a4ba27ee14b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:52.677709 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-79dd2647-aa81-4624-a7c1-8a4ba27ee14b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:52.678624 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-79dd2647-aa81-4624-a7c1-8a4ba27ee14b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:52.679140 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-79dd2647-aa81-4624-a7c1-8a4ba27ee14b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:52.679626 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-79dd2647-aa81-4624-a7c1-8a4ba27ee14b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:52.835344 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-79dd2647-aa81-4624-a7c1-8a4ba27ee14b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:52.847567 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-79dd2647-aa81-4624-a7c1-8a4ba27ee14b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1523 microversion: 2.1 time: 0.185761 Sep 06 22:43:52.848189 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 90/171] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:52 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:53.870523 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-09454923-722a-413e-81cd-b6f4824cfe35 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:53.871713 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-09454923-722a-413e-81cd-b6f4824cfe35 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:53.881584 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-09454923-722a-413e-81cd-b6f4824cfe35 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:53.882344 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-09454923-722a-413e-81cd-b6f4824cfe35 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:53.883038 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-09454923-722a-413e-81cd-b6f4824cfe35 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:53.884442 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-09454923-722a-413e-81cd-b6f4824cfe35 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:53.885037 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-09454923-722a-413e-81cd-b6f4824cfe35 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:53.885642 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-09454923-722a-413e-81cd-b6f4824cfe35 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:54.052312 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-09454923-722a-413e-81cd-b6f4824cfe35 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:54.064236 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-09454923-722a-413e-81cd-b6f4824cfe35 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1523 microversion: 2.1 time: 0.197630 Sep 06 22:43:54.066249 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 82/172] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:53 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:43:55.088196 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6d05cc22-a065-459d-a071-47aa230f04f3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:55.089427 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-6d05cc22-a065-459d-a071-47aa230f04f3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:55.095879 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6d05cc22-a065-459d-a071-47aa230f04f3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:55.096395 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6d05cc22-a065-459d-a071-47aa230f04f3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:55.096887 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6d05cc22-a065-459d-a071-47aa230f04f3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:55.097686 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6d05cc22-a065-459d-a071-47aa230f04f3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:55.098515 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6d05cc22-a065-459d-a071-47aa230f04f3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:55.099024 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6d05cc22-a065-459d-a071-47aa230f04f3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:55.240490 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6d05cc22-a065-459d-a071-47aa230f04f3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:55.248229 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-6d05cc22-a065-459d-a071-47aa230f04f3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1523 microversion: 2.1 time: 0.164289 Sep 06 22:43:55.248821 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 91/173] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:55 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:56.272239 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9718f2f7-a054-4940-ba40-9391431345c9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:56.272851 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9718f2f7-a054-4940-ba40-9391431345c9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:56.280893 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9718f2f7-a054-4940-ba40-9391431345c9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:56.281529 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9718f2f7-a054-4940-ba40-9391431345c9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:56.282514 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9718f2f7-a054-4940-ba40-9391431345c9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:56.283299 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9718f2f7-a054-4940-ba40-9391431345c9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:56.283752 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9718f2f7-a054-4940-ba40-9391431345c9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:56.284175 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9718f2f7-a054-4940-ba40-9391431345c9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:56.305874 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:43:56.421166 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9718f2f7-a054-4940-ba40-9391431345c9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:56.429402 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9718f2f7-a054-4940-ba40-9391431345c9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1523 microversion: 2.1 time: 0.161831 Sep 06 22:43:56.429967 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 83/174] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:56 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:57.451459 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d7071e75-2837-445a-b7f8-26522d8e064d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:57.452157 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-d7071e75-2837-445a-b7f8-26522d8e064d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:57.458848 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d7071e75-2837-445a-b7f8-26522d8e064d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:57.459319 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d7071e75-2837-445a-b7f8-26522d8e064d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:57.459739 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d7071e75-2837-445a-b7f8-26522d8e064d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:57.460416 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d7071e75-2837-445a-b7f8-26522d8e064d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:57.460886 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d7071e75-2837-445a-b7f8-26522d8e064d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:57.461300 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d7071e75-2837-445a-b7f8-26522d8e064d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:57.518943 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c6b0eb2a-aa93-4387-9eb9-a172f96ef252 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:57.520013 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c6b0eb2a-aa93-4387-9eb9-a172f96ef252 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:57.526698 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c6b0eb2a-aa93-4387-9eb9-a172f96ef252 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:57.527428 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c6b0eb2a-aa93-4387-9eb9-a172f96ef252 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:57.527928 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c6b0eb2a-aa93-4387-9eb9-a172f96ef252 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:57.528710 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c6b0eb2a-aa93-4387-9eb9-a172f96ef252 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:57.530015 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c6b0eb2a-aa93-4387-9eb9-a172f96ef252 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:57.530674 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c6b0eb2a-aa93-4387-9eb9-a172f96ef252 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:57.567744 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c6b0eb2a-aa93-4387-9eb9-a172f96ef252 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Going to try to terminate instance {{(pid=127088) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 22:43:57.611276 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-d7071e75-2837-445a-b7f8-26522d8e064d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:57.621367 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d7071e75-2837-445a-b7f8-26522d8e064d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1523 microversion: 2.1 time: 0.173718 Sep 06 22:43:57.622221 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 92/175] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:57 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:57.663338 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c6b0eb2a-aa93-4387-9eb9-a172f96ef252 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291" status: 204 len: 0 microversion: 2.1 time: 0.148935 Sep 06 22:43:57.664820 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 84/176] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Sep 6 22:43:57 2022] DELETE /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 22:43:57.672901 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d1bf6a3b-df1a-4029-b3f3-d3c87dd0eae2 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:57.673897 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-d1bf6a3b-df1a-4029-b3f3-d3c87dd0eae2 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:57.681324 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d1bf6a3b-df1a-4029-b3f3-d3c87dd0eae2 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:57.681798 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d1bf6a3b-df1a-4029-b3f3-d3c87dd0eae2 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:57.682243 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d1bf6a3b-df1a-4029-b3f3-d3c87dd0eae2 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:57.682922 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d1bf6a3b-df1a-4029-b3f3-d3c87dd0eae2 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:57.683480 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d1bf6a3b-df1a-4029-b3f3-d3c87dd0eae2 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:57.683759 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d1bf6a3b-df1a-4029-b3f3-d3c87dd0eae2 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:57.839802 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-d1bf6a3b-df1a-4029-b3f3-d3c87dd0eae2 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5264060ddd48afa8305c38a9bfa4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f01bb55623a4bf580008b75a9715796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:57.848960 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d1bf6a3b-df1a-4029-b3f3-d3c87dd0eae2 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291" status: 200 len: 1552 microversion: 2.1 time: 0.179784 Sep 06 22:43:57.849489 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 93/177] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:57 2022] GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 => generated 1552 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:43:58.647302 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a253b248-859c-4266-9629-598b589a08d0 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:58.647940 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a253b248-859c-4266-9629-598b589a08d0 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:58.655079 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a253b248-859c-4266-9629-598b589a08d0 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:58.655614 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a253b248-859c-4266-9629-598b589a08d0 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:58.657151 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a253b248-859c-4266-9629-598b589a08d0 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:58.658139 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a253b248-859c-4266-9629-598b589a08d0 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:58.658583 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a253b248-859c-4266-9629-598b589a08d0 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:58.659012 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a253b248-859c-4266-9629-598b589a08d0 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:58.829934 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a253b248-859c-4266-9629-598b589a08d0 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:58.840315 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a253b248-859c-4266-9629-598b589a08d0 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1523 microversion: 2.1 time: 0.198091 Sep 06 22:43:58.840931 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 85/178] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:58 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:43:58.872359 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-976f220c-8e63-45fd-a756-61eee84bea7d tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:58.873001 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-976f220c-8e63-45fd-a756-61eee84bea7d tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:58.879742 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-976f220c-8e63-45fd-a756-61eee84bea7d tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:58.880237 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-976f220c-8e63-45fd-a756-61eee84bea7d tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:58.880667 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-976f220c-8e63-45fd-a756-61eee84bea7d tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:58.881398 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-976f220c-8e63-45fd-a756-61eee84bea7d tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:58.881878 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-976f220c-8e63-45fd-a756-61eee84bea7d tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:58.882297 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-976f220c-8e63-45fd-a756-61eee84bea7d tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:59.012866 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-976f220c-8e63-45fd-a756-61eee84bea7d tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5264060ddd48afa8305c38a9bfa4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f01bb55623a4bf580008b75a9715796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:43:59.023756 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-976f220c-8e63-45fd-a756-61eee84bea7d tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291" status: 200 len: 1552 microversion: 2.1 time: 0.155823 Sep 06 22:43:59.024321 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 94/179] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:58 2022] GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:43:59.866189 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5e039958-5c89-4b0d-90bf-a96f8dc707d7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:43:59.866844 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5e039958-5c89-4b0d-90bf-a96f8dc707d7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:43:59.877313 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e039958-5c89-4b0d-90bf-a96f8dc707d7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:59.877874 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e039958-5c89-4b0d-90bf-a96f8dc707d7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:59.878223 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e039958-5c89-4b0d-90bf-a96f8dc707d7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:43:59.878926 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e039958-5c89-4b0d-90bf-a96f8dc707d7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:43:59.879375 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e039958-5c89-4b0d-90bf-a96f8dc707d7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:43:59.879791 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e039958-5c89-4b0d-90bf-a96f8dc707d7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:00.052927 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-1db56fc6-d230-4839-af3e-80ab205b93e6 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:00.053547 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-1db56fc6-d230-4839-af3e-80ab205b93e6 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:00.073391 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1db56fc6-d230-4839-af3e-80ab205b93e6 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:00.073798 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1db56fc6-d230-4839-af3e-80ab205b93e6 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:00.074691 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1db56fc6-d230-4839-af3e-80ab205b93e6 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:00.075108 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5e039958-5c89-4b0d-90bf-a96f8dc707d7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:00.075572 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1db56fc6-d230-4839-af3e-80ab205b93e6 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:00.076030 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1db56fc6-d230-4839-af3e-80ab205b93e6 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:00.076455 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1db56fc6-d230-4839-af3e-80ab205b93e6 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:00.091174 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5e039958-5c89-4b0d-90bf-a96f8dc707d7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1523 microversion: 2.1 time: 0.231588 Sep 06 22:44:00.091768 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 86/180] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:43:59 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1523 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:00.303860 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-1db56fc6-d230-4839-af3e-80ab205b93e6 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5264060ddd48afa8305c38a9bfa4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f01bb55623a4bf580008b75a9715796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:00.313563 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-1db56fc6-d230-4839-af3e-80ab205b93e6 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291" status: 200 len: 1552 microversion: 2.1 time: 0.270277 Sep 06 22:44:00.314640 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 95/181] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:00 2022] GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 => generated 1552 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:01.075232 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-8f072b04-b06a-4932-bbfe-d1a46c803122 req-4d2d3665-b70d-4b60-87f8-9f94f430f5d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4694c0a1-7900-4032-9200-acd16f179291", "name": "network-vif-deleted", "tag": "cc85e0fe-203e-42a2-8387-fa852cacaca4"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:44:01.087292 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-8f072b04-b06a-4932-bbfe-d1a46c803122 req-4d2d3665-b70d-4b60-87f8-9f94f430f5d1 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:01.088127 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-8f072b04-b06a-4932-bbfe-d1a46c803122 req-4d2d3665-b70d-4b60-87f8-9f94f430f5d1 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:01.088750 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-8f072b04-b06a-4932-bbfe-d1a46c803122 req-4d2d3665-b70d-4b60-87f8-9f94f430f5d1 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:01.116190 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-dc8249ca-9da5-4d11-968c-44bd8909e8cd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:01.117429 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-dc8249ca-9da5-4d11-968c-44bd8909e8cd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:01.123350 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-8f072b04-b06a-4932-bbfe-d1a46c803122 req-4d2d3665-b70d-4b60-87f8-9f94f430f5d1 service nova] Creating event network-vif-deleted:cc85e0fe-203e-42a2-8387-fa852cacaca4 for instance 4694c0a1-7900-4032-9200-acd16f179291 on hv-cinder-85220 Sep 06 22:44:01.128518 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dc8249ca-9da5-4d11-968c-44bd8909e8cd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:01.129262 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dc8249ca-9da5-4d11-968c-44bd8909e8cd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:01.131716 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dc8249ca-9da5-4d11-968c-44bd8909e8cd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:01.133004 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dc8249ca-9da5-4d11-968c-44bd8909e8cd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:01.134780 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dc8249ca-9da5-4d11-968c-44bd8909e8cd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:01.135401 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dc8249ca-9da5-4d11-968c-44bd8909e8cd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:01.136652 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-8f072b04-b06a-4932-bbfe-d1a46c803122 req-4d2d3665-b70d-4b60-87f8-9f94f430f5d1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080972 Sep 06 22:44:01.140329 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 87/182] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:44:01.313015 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-dc8249ca-9da5-4d11-968c-44bd8909e8cd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:01.322174 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-dc8249ca-9da5-4d11-968c-44bd8909e8cd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1523 microversion: 2.1 time: 0.210294 Sep 06 22:44:01.322935 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 96/183] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:01 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1523 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:44:01.346104 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-28346286-8944-44df-b470-fc60b72c1df7 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:01.346797 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-28346286-8944-44df-b470-fc60b72c1df7 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:01.353709 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-28346286-8944-44df-b470-fc60b72c1df7 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:01.354190 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-28346286-8944-44df-b470-fc60b72c1df7 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:01.354616 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-28346286-8944-44df-b470-fc60b72c1df7 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:01.355475 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-28346286-8944-44df-b470-fc60b72c1df7 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:01.355924 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-28346286-8944-44df-b470-fc60b72c1df7 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:01.356336 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-28346286-8944-44df-b470-fc60b72c1df7 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:01.439368 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-28346286-8944-44df-b470-fc60b72c1df7 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5264060ddd48afa8305c38a9bfa4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f01bb55623a4bf580008b75a9715796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:01.448385 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-28346286-8944-44df-b470-fc60b72c1df7 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291" status: 200 len: 1345 microversion: 2.1 time: 0.107001 Sep 06 22:44:01.449010 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 88/184] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:01 2022] GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 => generated 1345 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:44:02.349977 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-662001e2-cee5-433b-909d-e0a06bbfb18b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:02.351412 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-662001e2-cee5-433b-909d-e0a06bbfb18b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:02.366140 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-662001e2-cee5-433b-909d-e0a06bbfb18b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:02.367109 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-662001e2-cee5-433b-909d-e0a06bbfb18b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:02.367662 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-662001e2-cee5-433b-909d-e0a06bbfb18b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:02.368488 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-662001e2-cee5-433b-909d-e0a06bbfb18b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:02.369502 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-662001e2-cee5-433b-909d-e0a06bbfb18b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:02.370059 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-662001e2-cee5-433b-909d-e0a06bbfb18b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:02.473879 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f4d40dbb-22ae-4c67-9f50-fb04d2d9477f tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:02.474597 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f4d40dbb-22ae-4c67-9f50-fb04d2d9477f tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:02.488458 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4d40dbb-22ae-4c67-9f50-fb04d2d9477f tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:02.490676 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4d40dbb-22ae-4c67-9f50-fb04d2d9477f tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:02.492561 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4d40dbb-22ae-4c67-9f50-fb04d2d9477f tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:02.493481 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4d40dbb-22ae-4c67-9f50-fb04d2d9477f tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:02.493948 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4d40dbb-22ae-4c67-9f50-fb04d2d9477f tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:02.494823 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4d40dbb-22ae-4c67-9f50-fb04d2d9477f tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:02.522101 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-f4d40dbb-22ae-4c67-9f50-fb04d2d9477f tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] HTTP exception thrown: Instance 4694c0a1-7900-4032-9200-acd16f179291 could not be found. Sep 06 22:44:02.548750 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f4d40dbb-22ae-4c67-9f50-fb04d2d9477f tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Request method failure captured: Sep 06 22:44:02.548750 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 HTTP/1.1 Sep 06 22:44:02.548750 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept: application/json Sep 06 22:44:02.548750 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Sep 06 22:44:02.548750 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Connection: close Sep 06 22:44:02.548750 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Length: 0 Sep 06 22:44:02.548750 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Type: application/json Sep 06 22:44:02.548750 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Host: 10.222.0.39 Sep 06 22:44:02.548750 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Sep 06 22:44:02.548750 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Sep 06 22:44:02.548750 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjF8zupqzF1Bpg-fyzN5tRV4QFxXDWPDPhMT8hAaGOA_eiSd6LwTZJlr_o99RPOMitqRLx8OfQ3l_rPicaDZ1Jp01Yqy1BYYnjFBpvayKIlhj6tec3r9MSKoMk8QpCSbLxx8FbocizxRapfo9cOaEMk_dbYri1TwPuq_gJR8LnMzd3FkQ Sep 06 22:44:02.548750 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Sep 06 22:44:02.548750 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Sep 06 22:44:02.548750 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Sep 06 22:44:02.548750 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Sep 06 22:44:02.548750 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Sep 06 22:44:02.548750 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Sep 06 22:44:02.548750 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Id: 2f01bb55623a4bf580008b75a9715796 Sep 06 22:44:02.548750 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-DeleteServersTestJSON-121017841 Sep 06 22:44:02.548750 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Role: reader,member Sep 06 22:44:02.548750 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Sep 06 22:44:02.550148 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2f01bb55623a4bf580008b75a9715796"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2f01bb55623a4bf580008b75a9715796"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2f01bb55623a4bf580008b75a9715796"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2f01bb55623a4bf580008b75a9715796"}]}] Sep 06 22:44:02.550148 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-DeleteServersTestJSON-121017841 Sep 06 22:44:02.550148 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 2f01bb55623a4bf580008b75a9715796 Sep 06 22:44:02.550148 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-DeleteServersTestJSON-121017841 Sep 06 22:44:02.550148 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User: tempest-DeleteServersTestJSON-121017841-project Sep 06 22:44:02.550148 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Sep 06 22:44:02.550148 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Sep 06 22:44:02.550148 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Id: da5264060ddd48afa8305c38a9bfa4c3 Sep 06 22:44:02.550148 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-DeleteServersTestJSON-121017841-project Sep 06 22:44:02.550148 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: method: > Sep 06 22:44:02.550148 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: exception: Instance 4694c0a1-7900-4032-9200-acd16f179291 could not be found. Sep 06 22:44:02.550148 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: action_args: {'id': '4694c0a1-7900-4032-9200-acd16f179291'} Sep 06 22:44:02.550830 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:44:02.550830 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:44:02.550830 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:44:02.550830 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:44:02.550830 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:44:02.550830 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:44:02.550830 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:44:02.550830 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:44:02.550830 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:44:02.550830 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:44:02.550830 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4694c0a1-7900-4032-9200-acd16f179291 could not be found. Sep 06 22:44:02.550830 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:44:02.550830 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:44:02.550830 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:44:02.550830 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:44:02.550830 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:44:02.550830 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:44:02.550830 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:44:02.550830 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:44:02.550830 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:44:02.551943 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:44:02.551943 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 22:44:02.551943 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 22:44:02.551943 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:44:02.551943 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:44:02.551943 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:44:02.551943 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:44:02.551943 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4694c0a1-7900-4032-9200-acd16f179291 could not be found. Sep 06 22:44:02.551943 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:44:02.551943 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:44:02.551943 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:44:02.551943 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:44:02.551943 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:44:02.551943 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:44:02.551943 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:44:02.551943 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:44:02.551943 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4694c0a1-7900-4032-9200-acd16f179291 could not be found. Sep 06 22:44:02.551943 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:44:02.554392 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f4d40dbb-22ae-4c67-9f50-fb04d2d9477f tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Returning 404 to user: Instance 4694c0a1-7900-4032-9200-acd16f179291 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:44:02.555386 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f4d40dbb-22ae-4c67-9f50-fb04d2d9477f tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291" status: 404 len: 111 microversion: 2.1 time: 0.085475 Sep 06 22:44:02.556613 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 89/185] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:02 2022] GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 22:44:02.629538 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-662001e2-cee5-433b-909d-e0a06bbfb18b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:02.637367 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-662001e2-cee5-433b-909d-e0a06bbfb18b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1523 microversion: 2.1 time: 0.293027 Sep 06 22:44:02.655147 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 97/186] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:02 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1523 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:02.737294 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2194fa67-d1ce-416e-bde1-5601dab80788 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:02.746579 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2194fa67-d1ce-416e-bde1-5601dab80788 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:02.755379 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2194fa67-d1ce-416e-bde1-5601dab80788 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:02.756915 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2194fa67-d1ce-416e-bde1-5601dab80788 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:02.757529 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2194fa67-d1ce-416e-bde1-5601dab80788 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:02.758732 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2194fa67-d1ce-416e-bde1-5601dab80788 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:02.759325 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2194fa67-d1ce-416e-bde1-5601dab80788 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:02.760063 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2194fa67-d1ce-416e-bde1-5601dab80788 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:02.779333 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-2194fa67-d1ce-416e-bde1-5601dab80788 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] HTTP exception thrown: Instance 4694c0a1-7900-4032-9200-acd16f179291 could not be found. Sep 06 22:44:02.789668 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2194fa67-d1ce-416e-bde1-5601dab80788 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Request method failure captured: Sep 06 22:44:02.789668 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291/os-volume_attachments HTTP/1.1 Sep 06 22:44:02.789668 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept: application/json Sep 06 22:44:02.789668 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Sep 06 22:44:02.789668 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Connection: close Sep 06 22:44:02.789668 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Length: 0 Sep 06 22:44:02.789668 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Type: application/json Sep 06 22:44:02.789668 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Host: 10.222.0.39 Sep 06 22:44:02.789668 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Sep 06 22:44:02.789668 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Sep 06 22:44:02.789668 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjF8zupqzF1Bpg-fyzN5tRV4QFxXDWPDPhMT8hAaGOA_eiSd6LwTZJlr_o99RPOMitqRLx8OfQ3l_rPicaDZ1Jp01Yqy1BYYnjFBpvayKIlhj6tec3r9MSKoMk8QpCSbLxx8FbocizxRapfo9cOaEMk_dbYri1TwPuq_gJR8LnMzd3FkQ Sep 06 22:44:02.789668 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Sep 06 22:44:02.789668 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Sep 06 22:44:02.789668 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Sep 06 22:44:02.789668 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Sep 06 22:44:02.789668 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Sep 06 22:44:02.789668 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Sep 06 22:44:02.789668 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Id: 2f01bb55623a4bf580008b75a9715796 Sep 06 22:44:02.789668 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-DeleteServersTestJSON-121017841 Sep 06 22:44:02.789668 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Role: reader,member Sep 06 22:44:02.789668 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Sep 06 22:44:02.791171 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2f01bb55623a4bf580008b75a9715796"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2f01bb55623a4bf580008b75a9715796"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2f01bb55623a4bf580008b75a9715796"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2f01bb55623a4bf580008b75a9715796"}]}] Sep 06 22:44:02.791171 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-DeleteServersTestJSON-121017841 Sep 06 22:44:02.791171 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 2f01bb55623a4bf580008b75a9715796 Sep 06 22:44:02.791171 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-DeleteServersTestJSON-121017841 Sep 06 22:44:02.791171 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User: tempest-DeleteServersTestJSON-121017841-project Sep 06 22:44:02.791171 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Sep 06 22:44:02.791171 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Sep 06 22:44:02.791171 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Id: da5264060ddd48afa8305c38a9bfa4c3 Sep 06 22:44:02.791171 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-DeleteServersTestJSON-121017841-project Sep 06 22:44:02.791171 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: method: > Sep 06 22:44:02.791171 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: exception: Instance 4694c0a1-7900-4032-9200-acd16f179291 could not be found. Sep 06 22:44:02.791171 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: action_args: {'server_id': '4694c0a1-7900-4032-9200-acd16f179291'} Sep 06 22:44:02.791958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:44:02.791958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:44:02.791958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:44:02.791958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:44:02.791958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:44:02.791958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:44:02.791958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:44:02.791958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:44:02.791958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:44:02.791958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:44:02.791958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4694c0a1-7900-4032-9200-acd16f179291 could not be found. Sep 06 22:44:02.791958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:44:02.791958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:44:02.791958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:44:02.791958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:44:02.791958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:44:02.791958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:44:02.791958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:44:02.791958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:44:02.791958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:44:02.793246 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:44:02.793246 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 06 22:44:02.793246 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 22:44:02.793246 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 06 22:44:02.793246 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 22:44:02.793246 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 06 22:44:02.793246 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 06 22:44:02.793246 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:44:02.793246 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:44:02.793246 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4694c0a1-7900-4032-9200-acd16f179291 could not be found. Sep 06 22:44:02.793246 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:44:02.793246 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:44:02.793246 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:44:02.793246 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:44:02.793246 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:44:02.793246 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:44:02.793246 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:44:02.793246 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:44:02.793246 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4694c0a1-7900-4032-9200-acd16f179291 could not be found. Sep 06 22:44:02.793246 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:44:02.795137 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2194fa67-d1ce-416e-bde1-5601dab80788 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Returning 404 to user: Instance 4694c0a1-7900-4032-9200-acd16f179291 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:44:02.796152 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2194fa67-d1ce-416e-bde1-5601dab80788 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.065101 Sep 06 22:44:02.801140 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 90/187] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Sep 6 22:44:02 2022] GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291/os-volume_attachments => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 22:44:03.666173 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f452a8a6-1bb8-4dc1-befc-4b11fda13456 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:03.666828 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-f452a8a6-1bb8-4dc1-befc-4b11fda13456 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:03.674207 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f452a8a6-1bb8-4dc1-befc-4b11fda13456 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:03.674692 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f452a8a6-1bb8-4dc1-befc-4b11fda13456 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:03.675119 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f452a8a6-1bb8-4dc1-befc-4b11fda13456 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:03.675887 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f452a8a6-1bb8-4dc1-befc-4b11fda13456 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:03.676338 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f452a8a6-1bb8-4dc1-befc-4b11fda13456 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:03.676751 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f452a8a6-1bb8-4dc1-befc-4b11fda13456 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:03.862466 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-f452a8a6-1bb8-4dc1-befc-4b11fda13456 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:03.870421 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-f452a8a6-1bb8-4dc1-befc-4b11fda13456 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1523 microversion: 2.1 time: 0.208477 Sep 06 22:44:03.871273 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 98/188] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:03 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1523 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:04.017929 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-00ed9573-9dd1-4303-9a51-f30164c7ed87 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:04.019153 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-00ed9573-9dd1-4303-9a51-f30164c7ed87 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:04.025709 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00ed9573-9dd1-4303-9a51-f30164c7ed87 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:04.026217 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00ed9573-9dd1-4303-9a51-f30164c7ed87 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:04.026683 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00ed9573-9dd1-4303-9a51-f30164c7ed87 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:04.027382 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00ed9573-9dd1-4303-9a51-f30164c7ed87 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:04.027834 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00ed9573-9dd1-4303-9a51-f30164c7ed87 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:04.028251 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00ed9573-9dd1-4303-9a51-f30164c7ed87 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:04.042473 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-00ed9573-9dd1-4303-9a51-f30164c7ed87 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] HTTP exception thrown: Instance 4694c0a1-7900-4032-9200-acd16f179291 could not be found. Sep 06 22:44:04.044235 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-00ed9573-9dd1-4303-9a51-f30164c7ed87 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Request method failure captured: Sep 06 22:44:04.044235 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: request: DELETE /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 HTTP/1.1 Sep 06 22:44:04.044235 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept: application/json Sep 06 22:44:04.044235 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Sep 06 22:44:04.044235 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Connection: close Sep 06 22:44:04.044235 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Length: 0 Sep 06 22:44:04.044235 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Type: application/json Sep 06 22:44:04.044235 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Host: 10.222.0.39 Sep 06 22:44:04.044235 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Sep 06 22:44:04.044235 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Sep 06 22:44:04.044235 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjF8zupqzF1Bpg-fyzN5tRV4QFxXDWPDPhMT8hAaGOA_eiSd6LwTZJlr_o99RPOMitqRLx8OfQ3l_rPicaDZ1Jp01Yqy1BYYnjFBpvayKIlhj6tec3r9MSKoMk8QpCSbLxx8FbocizxRapfo9cOaEMk_dbYri1TwPuq_gJR8LnMzd3FkQ Sep 06 22:44:04.044235 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Sep 06 22:44:04.044235 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Sep 06 22:44:04.044235 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Sep 06 22:44:04.044235 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Sep 06 22:44:04.044235 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Sep 06 22:44:04.044235 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Sep 06 22:44:04.044235 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Id: 2f01bb55623a4bf580008b75a9715796 Sep 06 22:44:04.044235 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-DeleteServersTestJSON-121017841 Sep 06 22:44:04.044235 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Role: reader,member Sep 06 22:44:04.044235 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Sep 06 22:44:04.045690 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2f01bb55623a4bf580008b75a9715796"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2f01bb55623a4bf580008b75a9715796"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2f01bb55623a4bf580008b75a9715796"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2f01bb55623a4bf580008b75a9715796"}]}] Sep 06 22:44:04.045690 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-DeleteServersTestJSON-121017841 Sep 06 22:44:04.045690 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 2f01bb55623a4bf580008b75a9715796 Sep 06 22:44:04.045690 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-DeleteServersTestJSON-121017841 Sep 06 22:44:04.045690 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User: tempest-DeleteServersTestJSON-121017841-project Sep 06 22:44:04.045690 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Sep 06 22:44:04.045690 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Sep 06 22:44:04.045690 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Id: da5264060ddd48afa8305c38a9bfa4c3 Sep 06 22:44:04.045690 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-DeleteServersTestJSON-121017841-project Sep 06 22:44:04.045690 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: method: > Sep 06 22:44:04.045690 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: exception: Instance 4694c0a1-7900-4032-9200-acd16f179291 could not be found. Sep 06 22:44:04.045690 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: action_args: {'id': '4694c0a1-7900-4032-9200-acd16f179291'} Sep 06 22:44:04.049542 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:44:04.049542 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:44:04.049542 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:44:04.049542 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:44:04.049542 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:44:04.049542 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:44:04.049542 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:44:04.049542 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:44:04.049542 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:44:04.049542 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:44:04.049542 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4694c0a1-7900-4032-9200-acd16f179291 could not be found. Sep 06 22:44:04.049542 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:44:04.049542 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:44:04.049542 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:44:04.049542 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:44:04.049542 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:44:04.049542 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:44:04.049542 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:44:04.049542 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:44:04.049542 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:44:04.050927 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:44:04.050927 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 22:44:04.050927 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 22:44:04.050927 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 22:44:04.050927 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 22:44:04.050927 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:44:04.050927 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:44:04.050927 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:44:04.050927 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:44:04.050927 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4694c0a1-7900-4032-9200-acd16f179291 could not be found. Sep 06 22:44:04.050927 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:44:04.050927 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:44:04.050927 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:44:04.050927 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:44:04.050927 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:44:04.050927 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:44:04.050927 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:44:04.050927 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:44:04.050927 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4694c0a1-7900-4032-9200-acd16f179291 could not be found. Sep 06 22:44:04.050927 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:44:04.052267 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-00ed9573-9dd1-4303-9a51-f30164c7ed87 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Returning 404 to user: Instance 4694c0a1-7900-4032-9200-acd16f179291 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:44:04.052267 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-00ed9573-9dd1-4303-9a51-f30164c7ed87 tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291" status: 404 len: 111 microversion: 2.1 time: 0.032924 Sep 06 22:44:04.052267 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 91/189] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Sep 6 22:44:04 2022] DELETE /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 22:44:04.057527 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-69b198b2-4fd1-4627-9165-c8c2fedabb2c tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:04.058133 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-69b198b2-4fd1-4627-9165-c8c2fedabb2c tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] [instance: 4694c0a1-7900-4032-9200-acd16f179291] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:04.063926 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-69b198b2-4fd1-4627-9165-c8c2fedabb2c tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:04.064399 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-69b198b2-4fd1-4627-9165-c8c2fedabb2c tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:04.064914 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-69b198b2-4fd1-4627-9165-c8c2fedabb2c tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:04.065594 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-69b198b2-4fd1-4627-9165-c8c2fedabb2c tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:04.066031 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-69b198b2-4fd1-4627-9165-c8c2fedabb2c tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:04.066441 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-69b198b2-4fd1-4627-9165-c8c2fedabb2c tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:04.081228 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-69b198b2-4fd1-4627-9165-c8c2fedabb2c tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] HTTP exception thrown: Instance 4694c0a1-7900-4032-9200-acd16f179291 could not be found. Sep 06 22:44:04.085989 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-69b198b2-4fd1-4627-9165-c8c2fedabb2c tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Request method failure captured: Sep 06 22:44:04.085989 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: request: GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 HTTP/1.1 Sep 06 22:44:04.085989 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept: application/json Sep 06 22:44:04.085989 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Sep 06 22:44:04.085989 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Connection: close Sep 06 22:44:04.085989 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Length: 0 Sep 06 22:44:04.085989 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Type: application/json Sep 06 22:44:04.085989 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Host: 10.222.0.39 Sep 06 22:44:04.085989 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Sep 06 22:44:04.085989 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.12 Sep 06 22:44:04.085989 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABjF8zupqzF1Bpg-fyzN5tRV4QFxXDWPDPhMT8hAaGOA_eiSd6LwTZJlr_o99RPOMitqRLx8OfQ3l_rPicaDZ1Jp01Yqy1BYYnjFBpvayKIlhj6tec3r9MSKoMk8QpCSbLxx8FbocizxRapfo9cOaEMk_dbYri1TwPuq_gJR8LnMzd3FkQ Sep 06 22:44:04.085989 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Sep 06 22:44:04.085989 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Sep 06 22:44:04.085989 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Sep 06 22:44:04.085989 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Sep 06 22:44:04.085989 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Sep 06 22:44:04.085989 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Sep 06 22:44:04.085989 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Id: 2f01bb55623a4bf580008b75a9715796 Sep 06 22:44:04.085989 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-DeleteServersTestJSON-121017841 Sep 06 22:44:04.085989 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Role: reader,member Sep 06 22:44:04.085989 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Sep 06 22:44:04.087164 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2f01bb55623a4bf580008b75a9715796"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2f01bb55623a4bf580008b75a9715796"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2f01bb55623a4bf580008b75a9715796"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2f01bb55623a4bf580008b75a9715796"}]}] Sep 06 22:44:04.087164 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-DeleteServersTestJSON-121017841 Sep 06 22:44:04.087164 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 2f01bb55623a4bf580008b75a9715796 Sep 06 22:44:04.087164 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-DeleteServersTestJSON-121017841 Sep 06 22:44:04.087164 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User: tempest-DeleteServersTestJSON-121017841-project Sep 06 22:44:04.087164 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Sep 06 22:44:04.087164 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Sep 06 22:44:04.087164 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Id: da5264060ddd48afa8305c38a9bfa4c3 Sep 06 22:44:04.087164 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-DeleteServersTestJSON-121017841-project Sep 06 22:44:04.087164 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: method: > Sep 06 22:44:04.087164 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: exception: Instance 4694c0a1-7900-4032-9200-acd16f179291 could not be found. Sep 06 22:44:04.087164 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: action_args: {'id': '4694c0a1-7900-4032-9200-acd16f179291'} Sep 06 22:44:04.087972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:44:04.087972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:44:04.087972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:44:04.087972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:44:04.087972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:44:04.087972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:44:04.087972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:44:04.087972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:44:04.087972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:44:04.087972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:44:04.087972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4694c0a1-7900-4032-9200-acd16f179291 could not be found. Sep 06 22:44:04.087972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:44:04.087972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:44:04.087972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:44:04.087972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:44:04.087972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:44:04.087972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:44:04.087972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:44:04.087972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:44:04.087972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:44:04.089259 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:44:04.089259 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 22:44:04.089259 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 22:44:04.089259 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:44:04.089259 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:44:04.089259 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:44:04.089259 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:44:04.089259 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4694c0a1-7900-4032-9200-acd16f179291 could not be found. Sep 06 22:44:04.089259 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:44:04.089259 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:44:04.089259 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:44:04.089259 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:44:04.089259 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:44:04.089259 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:44:04.089259 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:44:04.089259 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:44:04.089259 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4694c0a1-7900-4032-9200-acd16f179291 could not be found. Sep 06 22:44:04.089259 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:44:04.090496 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-69b198b2-4fd1-4627-9165-c8c2fedabb2c tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] Returning 404 to user: Instance 4694c0a1-7900-4032-9200-acd16f179291 could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:44:04.090496 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-69b198b2-4fd1-4627-9165-c8c2fedabb2c tempest-DeleteServersTestJSON-121017841 tempest-DeleteServersTestJSON-121017841-project] 10.222.0.39 "GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291" status: 404 len: 111 microversion: 2.1 time: 0.033678 Sep 06 22:44:04.090496 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 99/190] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:04 2022] GET /compute/v2.1/servers/4694c0a1-7900-4032-9200-acd16f179291 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 22:44:04.895489 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c7e89e31-ce70-4ea6-9dfd-2ea26f6f34d7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:04.896423 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c7e89e31-ce70-4ea6-9dfd-2ea26f6f34d7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:04.902415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c7e89e31-ce70-4ea6-9dfd-2ea26f6f34d7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:04.903013 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c7e89e31-ce70-4ea6-9dfd-2ea26f6f34d7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:04.903542 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c7e89e31-ce70-4ea6-9dfd-2ea26f6f34d7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:04.904467 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c7e89e31-ce70-4ea6-9dfd-2ea26f6f34d7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:04.905065 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c7e89e31-ce70-4ea6-9dfd-2ea26f6f34d7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:04.905582 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c7e89e31-ce70-4ea6-9dfd-2ea26f6f34d7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:05.143800 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c7e89e31-ce70-4ea6-9dfd-2ea26f6f34d7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:05.152452 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c7e89e31-ce70-4ea6-9dfd-2ea26f6f34d7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1523 microversion: 2.1 time: 0.262644 Sep 06 22:44:05.153251 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 92/191] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:04 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1523 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:06.175949 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-daeb78b7-09c0-4765-9260-f66ea67bfa68 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:06.177231 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-daeb78b7-09c0-4765-9260-f66ea67bfa68 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:06.183234 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-daeb78b7-09c0-4765-9260-f66ea67bfa68 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:06.183724 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-daeb78b7-09c0-4765-9260-f66ea67bfa68 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:06.184156 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-daeb78b7-09c0-4765-9260-f66ea67bfa68 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:06.184867 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-daeb78b7-09c0-4765-9260-f66ea67bfa68 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:06.185516 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-daeb78b7-09c0-4765-9260-f66ea67bfa68 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:06.186214 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-daeb78b7-09c0-4765-9260-f66ea67bfa68 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:06.407971 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-daeb78b7-09c0-4765-9260-f66ea67bfa68 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:06.419584 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-daeb78b7-09c0-4765-9260-f66ea67bfa68 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1523 microversion: 2.1 time: 0.248041 Sep 06 22:44:06.420334 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 100/192] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:06 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1523 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:07.443690 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1d6d8996-d2b7-4ac4-9023-543a3bfe0915 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:07.444307 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1d6d8996-d2b7-4ac4-9023-543a3bfe0915 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:07.450634 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d6d8996-d2b7-4ac4-9023-543a3bfe0915 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:07.451111 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d6d8996-d2b7-4ac4-9023-543a3bfe0915 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:07.451707 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d6d8996-d2b7-4ac4-9023-543a3bfe0915 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:07.452572 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d6d8996-d2b7-4ac4-9023-543a3bfe0915 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:07.453324 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d6d8996-d2b7-4ac4-9023-543a3bfe0915 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:07.454061 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1d6d8996-d2b7-4ac4-9023-543a3bfe0915 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:07.853063 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1d6d8996-d2b7-4ac4-9023-543a3bfe0915 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:07.862614 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1d6d8996-d2b7-4ac4-9023-543a3bfe0915 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1523 microversion: 2.1 time: 0.422540 Sep 06 22:44:07.877001 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 93/193] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:07 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1523 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:08.888488 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-65a5bb8e-c6d2-4240-972b-f32fdfab8409 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:08.889763 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-65a5bb8e-c6d2-4240-972b-f32fdfab8409 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:08.899701 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-65a5bb8e-c6d2-4240-972b-f32fdfab8409 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:08.901370 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-65a5bb8e-c6d2-4240-972b-f32fdfab8409 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:08.905163 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-65a5bb8e-c6d2-4240-972b-f32fdfab8409 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:08.906009 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-65a5bb8e-c6d2-4240-972b-f32fdfab8409 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:08.907560 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-65a5bb8e-c6d2-4240-972b-f32fdfab8409 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:08.908601 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-65a5bb8e-c6d2-4240-972b-f32fdfab8409 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:09.112499 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-65a5bb8e-c6d2-4240-972b-f32fdfab8409 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:09.122573 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-65a5bb8e-c6d2-4240-972b-f32fdfab8409 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1523 microversion: 2.1 time: 0.238801 Sep 06 22:44:09.123518 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 101/194] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:08 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1523 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:10.147175 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-630d55ff-41cc-40a2-b223-e110e2660c03 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:10.147776 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-630d55ff-41cc-40a2-b223-e110e2660c03 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:10.154143 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-630d55ff-41cc-40a2-b223-e110e2660c03 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:10.154614 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-630d55ff-41cc-40a2-b223-e110e2660c03 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:10.155043 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-630d55ff-41cc-40a2-b223-e110e2660c03 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:10.155713 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-630d55ff-41cc-40a2-b223-e110e2660c03 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:10.156786 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-630d55ff-41cc-40a2-b223-e110e2660c03 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:10.157183 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-630d55ff-41cc-40a2-b223-e110e2660c03 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:10.285811 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-630d55ff-41cc-40a2-b223-e110e2660c03 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:10.293610 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-630d55ff-41cc-40a2-b223-e110e2660c03 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1523 microversion: 2.1 time: 0.150546 Sep 06 22:44:10.294188 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 94/195] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:10 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:11.316289 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-414f5dee-dfea-4107-a452-74a143af6e4d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:11.316865 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-414f5dee-dfea-4107-a452-74a143af6e4d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:11.322677 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-414f5dee-dfea-4107-a452-74a143af6e4d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:11.323153 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-414f5dee-dfea-4107-a452-74a143af6e4d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:11.323576 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-414f5dee-dfea-4107-a452-74a143af6e4d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:11.324247 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-414f5dee-dfea-4107-a452-74a143af6e4d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:11.324686 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-414f5dee-dfea-4107-a452-74a143af6e4d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:11.325126 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-414f5dee-dfea-4107-a452-74a143af6e4d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:11.455796 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-414f5dee-dfea-4107-a452-74a143af6e4d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:11.463527 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-414f5dee-dfea-4107-a452-74a143af6e4d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1523 microversion: 2.1 time: 0.151272 Sep 06 22:44:11.464394 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 102/196] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:11 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:12.493930 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-741bf3d0-4224-4762-b1ae-7c65c275058c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:12.494616 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-741bf3d0-4224-4762-b1ae-7c65c275058c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:12.501438 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-741bf3d0-4224-4762-b1ae-7c65c275058c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:12.501946 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-741bf3d0-4224-4762-b1ae-7c65c275058c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:12.502351 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-741bf3d0-4224-4762-b1ae-7c65c275058c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:12.503130 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-741bf3d0-4224-4762-b1ae-7c65c275058c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:12.503580 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-741bf3d0-4224-4762-b1ae-7c65c275058c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:12.503996 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-741bf3d0-4224-4762-b1ae-7c65c275058c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:12.652936 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-741bf3d0-4224-4762-b1ae-7c65c275058c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:12.660980 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-741bf3d0-4224-4762-b1ae-7c65c275058c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1523 microversion: 2.1 time: 0.170758 Sep 06 22:44:12.661549 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 95/197] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:12 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:13.683187 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-5f19aa83-00a7-4b9e-9b7d-40d31e407d17 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:13.683799 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-5f19aa83-00a7-4b9e-9b7d-40d31e407d17 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:13.691305 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5f19aa83-00a7-4b9e-9b7d-40d31e407d17 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:13.691783 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5f19aa83-00a7-4b9e-9b7d-40d31e407d17 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:13.692216 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5f19aa83-00a7-4b9e-9b7d-40d31e407d17 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:13.692931 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5f19aa83-00a7-4b9e-9b7d-40d31e407d17 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:13.693375 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5f19aa83-00a7-4b9e-9b7d-40d31e407d17 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:13.693811 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5f19aa83-00a7-4b9e-9b7d-40d31e407d17 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:13.821063 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-5f19aa83-00a7-4b9e-9b7d-40d31e407d17 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:13.828623 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-5f19aa83-00a7-4b9e-9b7d-40d31e407d17 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1523 microversion: 2.1 time: 0.149100 Sep 06 22:44:13.829233 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 103/198] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:13 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:14.850895 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b6147720-d0ea-47d9-894e-172fa6b65430 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:14.851500 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b6147720-d0ea-47d9-894e-172fa6b65430 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:14.857787 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b6147720-d0ea-47d9-894e-172fa6b65430 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:14.858264 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b6147720-d0ea-47d9-894e-172fa6b65430 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:14.858695 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b6147720-d0ea-47d9-894e-172fa6b65430 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:14.859428 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b6147720-d0ea-47d9-894e-172fa6b65430 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:14.859966 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b6147720-d0ea-47d9-894e-172fa6b65430 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:14.860491 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b6147720-d0ea-47d9-894e-172fa6b65430 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:15.136883 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b6147720-d0ea-47d9-894e-172fa6b65430 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:15.146692 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b6147720-d0ea-47d9-894e-172fa6b65430 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1523 microversion: 2.1 time: 0.299671 Sep 06 22:44:15.147269 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 96/199] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:14 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1523 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:44:15.790219 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-88cf3a67-b113-4f33-9357-375af1c41df6 tempest-VolumesTestJSON-471199693 tempest-VolumesTestJSON-471199693-project] Calling method '.version_select at 0x7f9c4f9900d0>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:15.844433 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-88cf3a67-b113-4f33-9357-375af1c41df6 tempest-VolumesTestJSON-471199693 tempest-VolumesTestJSON-471199693-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/630136aa-4faa-4c46-a219-4863361003ee" status: 200 len: 351 microversion: 2.1 time: 0.057666 Sep 06 22:44:15.845422 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 104/200] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Sep 6 22:44:15 2022] GET /compute/v2.1/os-volumes/630136aa-4faa-4c46-a219-4863361003ee => generated 351 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:44:16.169945 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4e339967-4f28-43a1-ae25-00c4018a0c8b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:16.170688 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4e339967-4f28-43a1-ae25-00c4018a0c8b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:16.173528 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:44:16.178366 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4e339967-4f28-43a1-ae25-00c4018a0c8b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:16.179023 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4e339967-4f28-43a1-ae25-00c4018a0c8b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:16.179629 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4e339967-4f28-43a1-ae25-00c4018a0c8b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:16.180698 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4e339967-4f28-43a1-ae25-00c4018a0c8b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:16.181394 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4e339967-4f28-43a1-ae25-00c4018a0c8b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:16.182014 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4e339967-4f28-43a1-ae25-00c4018a0c8b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:16.319131 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4e339967-4f28-43a1-ae25-00c4018a0c8b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:16.326972 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4e339967-4f28-43a1-ae25-00c4018a0c8b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1523 microversion: 2.1 time: 0.160947 Sep 06 22:44:16.327688 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 97/201] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:16 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:17.350543 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-8feacafd-7376-4178-8506-f60e10be29c4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:17.351142 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-8feacafd-7376-4178-8506-f60e10be29c4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:17.353055 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=38 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:44:17.358181 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8feacafd-7376-4178-8506-f60e10be29c4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:17.358658 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8feacafd-7376-4178-8506-f60e10be29c4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:17.359083 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8feacafd-7376-4178-8506-f60e10be29c4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:17.360269 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8feacafd-7376-4178-8506-f60e10be29c4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:17.360885 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8feacafd-7376-4178-8506-f60e10be29c4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:17.361194 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8feacafd-7376-4178-8506-f60e10be29c4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:17.499822 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-8feacafd-7376-4178-8506-f60e10be29c4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:17.512501 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-8feacafd-7376-4178-8506-f60e10be29c4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1523 microversion: 2.1 time: 0.165792 Sep 06 22:44:17.525098 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 105/202] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:17 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:18.536472 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-01b08e05-fd9e-491f-87eb-271ccb2d52f9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:18.537139 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-01b08e05-fd9e-491f-87eb-271ccb2d52f9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:18.543349 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01b08e05-fd9e-491f-87eb-271ccb2d52f9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:18.543756 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01b08e05-fd9e-491f-87eb-271ccb2d52f9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:18.544315 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01b08e05-fd9e-491f-87eb-271ccb2d52f9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:18.545037 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01b08e05-fd9e-491f-87eb-271ccb2d52f9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:18.545488 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01b08e05-fd9e-491f-87eb-271ccb2d52f9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:18.545904 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01b08e05-fd9e-491f-87eb-271ccb2d52f9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:18.683865 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-01b08e05-fd9e-491f-87eb-271ccb2d52f9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:18.692391 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-01b08e05-fd9e-491f-87eb-271ccb2d52f9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1523 microversion: 2.1 time: 0.160917 Sep 06 22:44:18.692991 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 98/203] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:18 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:19.367981 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ea009e26-4df0-4e75-a6c8-42d494284002 tempest-VolumesTestJSON-471199693 tempest-VolumesTestJSON-471199693-project] Calling method '.version_select at 0x7f9c4f992700>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:19.428967 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ea009e26-4df0-4e75-a6c8-42d494284002 tempest-VolumesTestJSON-471199693 tempest-VolumesTestJSON-471199693-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/b05e89b8-0d76-42c0-a85d-34f987180dbd" status: 200 len: 351 microversion: 2.1 time: 0.064971 Sep 06 22:44:19.429569 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 106/204] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Sep 6 22:44:19 2022] GET /compute/v2.1/os-volumes/b05e89b8-0d76-42c0-a85d-34f987180dbd => generated 351 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:44:19.717574 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7ea6125b-9baf-47be-90ef-d5153ac98fa2 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:19.718315 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7ea6125b-9baf-47be-90ef-d5153ac98fa2 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:19.741108 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7ea6125b-9baf-47be-90ef-d5153ac98fa2 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:19.741958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7ea6125b-9baf-47be-90ef-d5153ac98fa2 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:19.742691 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7ea6125b-9baf-47be-90ef-d5153ac98fa2 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:19.744177 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7ea6125b-9baf-47be-90ef-d5153ac98fa2 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:19.744824 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7ea6125b-9baf-47be-90ef-d5153ac98fa2 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:19.745407 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7ea6125b-9baf-47be-90ef-d5153ac98fa2 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:19.939037 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7ea6125b-9baf-47be-90ef-d5153ac98fa2 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:19.947404 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7ea6125b-9baf-47be-90ef-d5153ac98fa2 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1523 microversion: 2.1 time: 0.235451 Sep 06 22:44:19.947976 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 99/205] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:19 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1523 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:20.877589 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-c465e5cc-7756-41dd-8195-bd97fe650ea2 tempest-VolumesTestJSON-471199693 tempest-VolumesTestJSON-471199693-project] Calling method '.version_select at 0x7f9c4f9920d0>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:20.926123 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-c465e5cc-7756-41dd-8195-bd97fe650ea2 tempest-VolumesTestJSON-471199693 tempest-VolumesTestJSON-471199693-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/85f61562-8a4e-42e5-874a-8bbfb02d1874" status: 200 len: 351 microversion: 2.1 time: 0.052248 Sep 06 22:44:20.926752 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 107/206] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Sep 6 22:44:20 2022] GET /compute/v2.1/os-volumes/85f61562-8a4e-42e5-874a-8bbfb02d1874 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:44:20.941215 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f9b37be4-7732-481e-9418-f10d0769354a tempest-VolumesTestJSON-471199693 tempest-VolumesTestJSON-471199693-project] Calling method '.version_select at 0x7f9c4f815940>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:20.975249 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ab85ada0-defc-447f-96ca-2a08fd2e338c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:20.975893 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ab85ada0-defc-447f-96ca-2a08fd2e338c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:20.983048 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ab85ada0-defc-447f-96ca-2a08fd2e338c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:20.983554 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ab85ada0-defc-447f-96ca-2a08fd2e338c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:20.984081 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ab85ada0-defc-447f-96ca-2a08fd2e338c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:20.986125 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ab85ada0-defc-447f-96ca-2a08fd2e338c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:20.986606 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ab85ada0-defc-447f-96ca-2a08fd2e338c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:20.987054 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ab85ada0-defc-447f-96ca-2a08fd2e338c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:21.009623 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=89 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:44:21.045001 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f9b37be4-7732-481e-9418-f10d0769354a tempest-VolumesTestJSON-471199693 tempest-VolumesTestJSON-471199693-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.107303 Sep 06 22:44:21.045843 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 100/207] 10.222.0.39 () {58 vars in 1134 bytes} [Tue Sep 6 22:44:20 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:21.065504 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c34c0c18-7859-443c-a0b7-7e1d614b59f5 tempest-VolumesTestJSON-471199693 tempest-VolumesTestJSON-471199693-project] Calling method '.version_select at 0x7f9c4f868c10>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:21.146327 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ab85ada0-defc-447f-96ca-2a08fd2e338c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:21.154020 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c34c0c18-7859-443c-a0b7-7e1d614b59f5 tempest-VolumesTestJSON-471199693 tempest-VolumesTestJSON-471199693-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.093269 Sep 06 22:44:21.154783 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 101/208] 10.222.0.39 () {58 vars in 1149 bytes} [Tue Sep 6 22:44:21 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:44:21.154960 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ab85ada0-defc-447f-96ca-2a08fd2e338c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1523 microversion: 2.1 time: 0.185114 Sep 06 22:44:21.155680 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 108/209] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:20 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:21.168471 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-654e183a-065a-40e3-a5c6-03ffaaf6d155 tempest-VolumesTestJSON-471199693 tempest-VolumesTestJSON-471199693-project] Calling method '.version_select at 0x7f9c4f883e50>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:21.253073 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-654e183a-065a-40e3-a5c6-03ffaaf6d155 tempest-VolumesTestJSON-471199693 tempest-VolumesTestJSON-471199693-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.088217 Sep 06 22:44:21.253642 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 102/210] 10.222.0.39 () {58 vars in 1134 bytes} [Tue Sep 6 22:44:21 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:21.266980 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-495ab79c-3160-4a5d-b1e9-5f5d9aa746b3 tempest-VolumesTestJSON-471199693 tempest-VolumesTestJSON-471199693-project] Calling method '.version_select at 0x7f9c4f9901f0>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:21.348891 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-495ab79c-3160-4a5d-b1e9-5f5d9aa746b3 tempest-VolumesTestJSON-471199693 tempest-VolumesTestJSON-471199693-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085810 Sep 06 22:44:21.349544 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 109/211] 10.222.0.39 () {58 vars in 1167 bytes} [Tue Sep 6 22:44:21 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:44:21.365118 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f04a19ce-3ea2-4cf9-bbb7-d239421e48a3 tempest-VolumesTestJSON-471199693 tempest-VolumesTestJSON-471199693-project] Calling method '.version_select at 0x7f9c4f815700>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:21.452997 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f04a19ce-3ea2-4cf9-bbb7-d239421e48a3 tempest-VolumesTestJSON-471199693 tempest-VolumesTestJSON-471199693-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.088612 Sep 06 22:44:21.452997 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 103/212] 10.222.0.39 () {58 vars in 1170 bytes} [Tue Sep 6 22:44:21 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:44:21.465182 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9430d491-7b5e-4b4e-a013-70d7cf3f0d3e tempest-VolumesTestJSON-471199693 tempest-VolumesTestJSON-471199693-project] Calling method '.version_select at 0x7f9c4f992d30>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:21.546355 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9430d491-7b5e-4b4e-a013-70d7cf3f0d3e tempest-VolumesTestJSON-471199693 tempest-VolumesTestJSON-471199693-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.084876 Sep 06 22:44:21.546926 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 110/213] 10.222.0.39 () {58 vars in 1155 bytes} [Tue Sep 6 22:44:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:21.560268 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-01c30145-2ae0-49f4-8252-aef3d5abbb3a tempest-VolumesTestJSON-471199693 tempest-VolumesTestJSON-471199693-project] Calling method '.version_select at 0x7f9c4fb47d30>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:21.646317 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-01c30145-2ae0-49f4-8252-aef3d5abbb3a tempest-VolumesTestJSON-471199693 tempest-VolumesTestJSON-471199693-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.089753 Sep 06 22:44:21.647899 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 104/214] 10.222.0.39 () {58 vars in 1188 bytes} [Tue Sep 6 22:44:21 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:44:21.662812 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-7deb234a-114b-45ab-9bb1-5f6d86406560 tempest-VolumesTestJSON-471199693 tempest-VolumesTestJSON-471199693-project] Calling method '.version_select at 0x7f9c4f91d940>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:21.751925 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-7deb234a-114b-45ab-9bb1-5f6d86406560 tempest-VolumesTestJSON-471199693 tempest-VolumesTestJSON-471199693-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.093425 Sep 06 22:44:21.752573 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 111/215] 10.222.0.39 () {58 vars in 1155 bytes} [Tue Sep 6 22:44:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:22.180684 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-962bc476-70bb-4026-8017-a53e0f1d2e2c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:22.181323 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-962bc476-70bb-4026-8017-a53e0f1d2e2c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:22.188592 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-962bc476-70bb-4026-8017-a53e0f1d2e2c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:22.189106 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-962bc476-70bb-4026-8017-a53e0f1d2e2c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:22.190018 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-962bc476-70bb-4026-8017-a53e0f1d2e2c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:22.190203 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-962bc476-70bb-4026-8017-a53e0f1d2e2c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:22.191002 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-962bc476-70bb-4026-8017-a53e0f1d2e2c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:22.191368 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-962bc476-70bb-4026-8017-a53e0f1d2e2c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:22.368027 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-962bc476-70bb-4026-8017-a53e0f1d2e2c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:22.378441 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-962bc476-70bb-4026-8017-a53e0f1d2e2c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1523 microversion: 2.1 time: 0.202506 Sep 06 22:44:22.381571 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 105/216] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:22 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1523 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:23.403309 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-c15781c1-a49e-4385-a564-af4069078793 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:23.403907 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-c15781c1-a49e-4385-a564-af4069078793 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:23.410596 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c15781c1-a49e-4385-a564-af4069078793 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:23.411003 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c15781c1-a49e-4385-a564-af4069078793 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:23.411427 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c15781c1-a49e-4385-a564-af4069078793 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:23.412105 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c15781c1-a49e-4385-a564-af4069078793 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:23.412546 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c15781c1-a49e-4385-a564-af4069078793 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:23.413005 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c15781c1-a49e-4385-a564-af4069078793 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:23.555298 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-c15781c1-a49e-4385-a564-af4069078793 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:23.566270 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-c15781c1-a49e-4385-a564-af4069078793 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1523 microversion: 2.1 time: 0.166669 Sep 06 22:44:23.566846 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 112/217] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:23 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:24.590577 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-70d6fda9-4c8b-48cc-b47f-7fca4fca6a3a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:24.591854 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-70d6fda9-4c8b-48cc-b47f-7fca4fca6a3a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:24.598539 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-70d6fda9-4c8b-48cc-b47f-7fca4fca6a3a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:24.599081 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-70d6fda9-4c8b-48cc-b47f-7fca4fca6a3a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:24.599473 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-70d6fda9-4c8b-48cc-b47f-7fca4fca6a3a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:24.600653 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-70d6fda9-4c8b-48cc-b47f-7fca4fca6a3a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:24.601357 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-70d6fda9-4c8b-48cc-b47f-7fca4fca6a3a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:24.601931 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-70d6fda9-4c8b-48cc-b47f-7fca4fca6a3a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:24.620784 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:44:24.818043 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-70d6fda9-4c8b-48cc-b47f-7fca4fca6a3a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:24.830525 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-70d6fda9-4c8b-48cc-b47f-7fca4fca6a3a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1523 microversion: 2.1 time: 0.243745 Sep 06 22:44:24.831372 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 106/218] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:24 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1523 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:25.853929 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-95dc0807-41ec-4dda-945e-c1f918542093 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:25.854529 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-95dc0807-41ec-4dda-945e-c1f918542093 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:25.860614 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-95dc0807-41ec-4dda-945e-c1f918542093 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:25.861352 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-95dc0807-41ec-4dda-945e-c1f918542093 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:25.861967 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-95dc0807-41ec-4dda-945e-c1f918542093 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:25.862700 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-95dc0807-41ec-4dda-945e-c1f918542093 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:25.863299 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-95dc0807-41ec-4dda-945e-c1f918542093 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:25.863861 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-95dc0807-41ec-4dda-945e-c1f918542093 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:26.113719 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-95dc0807-41ec-4dda-945e-c1f918542093 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:26.123571 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-95dc0807-41ec-4dda-945e-c1f918542093 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1523 microversion: 2.1 time: 0.273334 Sep 06 22:44:26.124348 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 113/219] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:25 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1523 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:27.147969 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a65a4560-f86c-4fdf-ab56-a30303320cc4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:27.149174 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a65a4560-f86c-4fdf-ab56-a30303320cc4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:27.157623 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a65a4560-f86c-4fdf-ab56-a30303320cc4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:27.158384 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a65a4560-f86c-4fdf-ab56-a30303320cc4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:27.158824 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a65a4560-f86c-4fdf-ab56-a30303320cc4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:27.159764 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a65a4560-f86c-4fdf-ab56-a30303320cc4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:27.160473 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a65a4560-f86c-4fdf-ab56-a30303320cc4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:27.160932 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a65a4560-f86c-4fdf-ab56-a30303320cc4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:27.345010 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a65a4560-f86c-4fdf-ab56-a30303320cc4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:27.362231 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a65a4560-f86c-4fdf-ab56-a30303320cc4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1523 microversion: 2.1 time: 0.218308 Sep 06 22:44:27.362815 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 107/220] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:27 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:28.386152 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e39100e5-227e-4e8a-9aed-67f0a54d3dfd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:28.386940 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e39100e5-227e-4e8a-9aed-67f0a54d3dfd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:28.393274 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e39100e5-227e-4e8a-9aed-67f0a54d3dfd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:28.393758 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e39100e5-227e-4e8a-9aed-67f0a54d3dfd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:28.394191 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e39100e5-227e-4e8a-9aed-67f0a54d3dfd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:28.395124 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e39100e5-227e-4e8a-9aed-67f0a54d3dfd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:28.395737 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e39100e5-227e-4e8a-9aed-67f0a54d3dfd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:28.396465 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e39100e5-227e-4e8a-9aed-67f0a54d3dfd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:28.556307 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e39100e5-227e-4e8a-9aed-67f0a54d3dfd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:28.564896 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e39100e5-227e-4e8a-9aed-67f0a54d3dfd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1523 microversion: 2.1 time: 0.182347 Sep 06 22:44:28.565478 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 114/221] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:28 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:44:29.591162 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fc144758-6479-4f32-90ae-0e34676bc7a2 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:29.591852 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fc144758-6479-4f32-90ae-0e34676bc7a2 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:29.600439 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fc144758-6479-4f32-90ae-0e34676bc7a2 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:29.601365 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fc144758-6479-4f32-90ae-0e34676bc7a2 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:29.601835 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fc144758-6479-4f32-90ae-0e34676bc7a2 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:29.602971 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fc144758-6479-4f32-90ae-0e34676bc7a2 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:29.603574 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fc144758-6479-4f32-90ae-0e34676bc7a2 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:29.604178 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fc144758-6479-4f32-90ae-0e34676bc7a2 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:29.819170 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fc144758-6479-4f32-90ae-0e34676bc7a2 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:29.828936 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fc144758-6479-4f32-90ae-0e34676bc7a2 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1523 microversion: 2.1 time: 0.241342 Sep 06 22:44:29.829521 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 108/222] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:29 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1523 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:30.854220 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b876dd48-4aa3-4e1b-85d8-0ca4df1d7325 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:30.854834 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b876dd48-4aa3-4e1b-85d8-0ca4df1d7325 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:30.862048 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b876dd48-4aa3-4e1b-85d8-0ca4df1d7325 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:30.862623 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b876dd48-4aa3-4e1b-85d8-0ca4df1d7325 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:30.863140 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b876dd48-4aa3-4e1b-85d8-0ca4df1d7325 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:30.863830 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b876dd48-4aa3-4e1b-85d8-0ca4df1d7325 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:30.864350 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b876dd48-4aa3-4e1b-85d8-0ca4df1d7325 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:30.864790 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b876dd48-4aa3-4e1b-85d8-0ca4df1d7325 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:30.902906 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3173d82a-a127-43e7-99ae-23bed8d51ac0 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1375449216", "imageRef": "93326d5e-4826-431e-9ad1-6ee2d44e48d9", "flavorRef": "452", "networks": [{"uuid": "551795b5-57c5-49e5-b362-817642010952"}]}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:44:30.969149 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.network.neutron [None req-3173d82a-a127-43e7-99ae-23bed8d51ac0 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] validate_networks() for [('551795b5-57c5-49e5-b362-817642010952', None, None, None, None, None)] {{(pid=127088) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 22:44:31.098687 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b876dd48-4aa3-4e1b-85d8-0ca4df1d7325 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:31.107032 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b876dd48-4aa3-4e1b-85d8-0ca4df1d7325 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1523 microversion: 2.1 time: 0.257081 Sep 06 22:44:31.107599 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 115/223] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:30 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1523 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:31.391747 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-3173d82a-a127-43e7-99ae-23bed8d51ac0 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Flavor limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 22:44:31.392201 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-3173d82a-a127-43e7-99ae-23bed8d51ac0 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Image limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 22:44:31.392701 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-3173d82a-a127-43e7-99ae-23bed8d51ac0 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Flavor pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 22:44:31.393124 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-3173d82a-a127-43e7-99ae-23bed8d51ac0 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Image pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 22:44:31.393537 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-3173d82a-a127-43e7-99ae-23bed8d51ac0 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 22:44:31.402575 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3173d82a-a127-43e7-99ae-23bed8d51ac0 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:31.403057 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3173d82a-a127-43e7-99ae-23bed8d51ac0 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:31.403486 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3173d82a-a127-43e7-99ae-23bed8d51ac0 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:31.404216 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3173d82a-a127-43e7-99ae-23bed8d51ac0 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:31.404668 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3173d82a-a127-43e7-99ae-23bed8d51ac0 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:31.405119 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3173d82a-a127-43e7-99ae-23bed8d51ac0 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:31.423209 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-3173d82a-a127-43e7-99ae-23bed8d51ac0 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Getting quotas for project 3ebbea5186774c59942358c1fc284fa7. Resources: {'instances', 'ram', 'cores'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 22:44:31.427191 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-3173d82a-a127-43e7-99ae-23bed8d51ac0 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Getting quotas for user 81d8036279ef4384bdbfa8c37e46a1d6 and project 3ebbea5186774c59942358c1fc284fa7. Resources: {'instances', 'ram', 'cores'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 22:44:31.441738 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3173d82a-a127-43e7-99ae-23bed8d51ac0 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Going to run 1 instances... {{(pid=127088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 22:44:31.444313 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3173d82a-a127-43e7-99ae-23bed8d51ac0 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c9f58e44-e53c-4224-9b62-a3c23ba54ade] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='93326d5e-4826-431e-9ad1-6ee2d44e48d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 22:44:31.493541 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3173d82a-a127-43e7-99ae-23bed8d51ac0 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.594837 Sep 06 22:44:31.494173 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 109/224] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Sep 6 22:44:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 22:44:31.506966 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ea984249-c2db-43b2-bd98-97d259c1dcd5 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:31.507778 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ea984249-c2db-43b2-bd98-97d259c1dcd5 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c9f58e44-e53c-4224-9b62-a3c23ba54ade] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:31.590957 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ea984249-c2db-43b2-bd98-97d259c1dcd5 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8036279ef4384bdbfa8c37e46a1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebbea5186774c59942358c1fc284fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:31.599120 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ea984249-c2db-43b2-bd98-97d259c1dcd5 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade" status: 200 len: 1219 microversion: 2.1 time: 0.096246 Sep 06 22:44:31.599697 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 116/225] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:31 2022] GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:32.132379 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5f80cbdc-9b32-4a3a-9081-51c53718291c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:32.133355 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5f80cbdc-9b32-4a3a-9081-51c53718291c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:32.142010 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5f80cbdc-9b32-4a3a-9081-51c53718291c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:32.142762 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5f80cbdc-9b32-4a3a-9081-51c53718291c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:32.143432 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5f80cbdc-9b32-4a3a-9081-51c53718291c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:32.144397 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5f80cbdc-9b32-4a3a-9081-51c53718291c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:32.145322 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5f80cbdc-9b32-4a3a-9081-51c53718291c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:32.145930 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5f80cbdc-9b32-4a3a-9081-51c53718291c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:32.283931 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5f80cbdc-9b32-4a3a-9081-51c53718291c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:32.294021 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5f80cbdc-9b32-4a3a-9081-51c53718291c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1503 microversion: 2.1 time: 0.165067 Sep 06 22:44:32.294996 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 110/226] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:32 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:32.319730 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-dbc746fc-bb11-4fdd-9fd1-f872573b4106 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:32.320333 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-dbc746fc-bb11-4fdd-9fd1-f872573b4106 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 5bcd7a9d-c2c8-489c-9827-b6be1508d63c] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:32.328734 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dbc746fc-bb11-4fdd-9fd1-f872573b4106 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:32.329426 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dbc746fc-bb11-4fdd-9fd1-f872573b4106 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:32.330051 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dbc746fc-bb11-4fdd-9fd1-f872573b4106 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:32.330737 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dbc746fc-bb11-4fdd-9fd1-f872573b4106 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:32.331495 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dbc746fc-bb11-4fdd-9fd1-f872573b4106 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:32.332063 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dbc746fc-bb11-4fdd-9fd1-f872573b4106 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:32.495593 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-dbc746fc-bb11-4fdd-9fd1-f872573b4106 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:32.503983 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-dbc746fc-bb11-4fdd-9fd1-f872573b4106 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c" status: 200 len: 1516 microversion: 2.1 time: 0.188415 Sep 06 22:44:32.504544 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 117/227] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:32 2022] GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c => generated 1516 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:32.627162 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-04dce93e-f2e3-4cc5-94bc-f17b15d93561 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:32.627792 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-04dce93e-f2e3-4cc5-94bc-f17b15d93561 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c9f58e44-e53c-4224-9b62-a3c23ba54ade] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:32.636212 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04dce93e-f2e3-4cc5-94bc-f17b15d93561 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:32.637062 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04dce93e-f2e3-4cc5-94bc-f17b15d93561 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:32.637843 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04dce93e-f2e3-4cc5-94bc-f17b15d93561 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:32.638702 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04dce93e-f2e3-4cc5-94bc-f17b15d93561 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:32.639902 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04dce93e-f2e3-4cc5-94bc-f17b15d93561 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:32.641049 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-04dce93e-f2e3-4cc5-94bc-f17b15d93561 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:32.722148 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-04dce93e-f2e3-4cc5-94bc-f17b15d93561 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8036279ef4384bdbfa8c37e46a1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebbea5186774c59942358c1fc284fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:32.735923 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-04dce93e-f2e3-4cc5-94bc-f17b15d93561 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade" status: 200 len: 1271 microversion: 2.1 time: 0.115726 Sep 06 22:44:32.736937 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 111/228] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:32 2022] GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade => generated 1271 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:33.760340 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-5e9b491b-a1ea-49fa-ac6d-a0db5064cb01 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:33.761198 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-5e9b491b-a1ea-49fa-ac6d-a0db5064cb01 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c9f58e44-e53c-4224-9b62-a3c23ba54ade] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:33.768427 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e9b491b-a1ea-49fa-ac6d-a0db5064cb01 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:33.768982 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e9b491b-a1ea-49fa-ac6d-a0db5064cb01 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:33.769727 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e9b491b-a1ea-49fa-ac6d-a0db5064cb01 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:33.771180 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e9b491b-a1ea-49fa-ac6d-a0db5064cb01 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:33.772060 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e9b491b-a1ea-49fa-ac6d-a0db5064cb01 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:33.772819 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e9b491b-a1ea-49fa-ac6d-a0db5064cb01 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:33.975565 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-27a2408f-8845-4219-97aa-b9a1a45cb106 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:44:33.978276 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-27a2408f-8845-4219-97aa-b9a1a45cb106 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 5bcd7a9d-c2c8-489c-9827-b6be1508d63c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:33.984749 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-27a2408f-8845-4219-97aa-b9a1a45cb106 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:33.985279 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-27a2408f-8845-4219-97aa-b9a1a45cb106 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:33.985696 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-27a2408f-8845-4219-97aa-b9a1a45cb106 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:33.986401 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-27a2408f-8845-4219-97aa-b9a1a45cb106 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:33.986852 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-27a2408f-8845-4219-97aa-b9a1a45cb106 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:33.987999 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-27a2408f-8845-4219-97aa-b9a1a45cb106 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:34.011849 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-27a2408f-8845-4219-97aa-b9a1a45cb106 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lazy-loading 'flavor' on Instance uuid 5bcd7a9d-c2c8-489c-9827-b6be1508d63c {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 22:44:34.020201 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-5e9b491b-a1ea-49fa-ac6d-a0db5064cb01 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8036279ef4384bdbfa8c37e46a1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebbea5186774c59942358c1fc284fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:34.030195 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-5e9b491b-a1ea-49fa-ac6d-a0db5064cb01 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade" status: 200 len: 1319 microversion: 2.1 time: 0.272274 Sep 06 22:44:34.038112 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 118/229] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:33 2022] GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade => generated 1319 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:34.112340 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-27a2408f-8845-4219-97aa-b9a1a45cb106 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "POST /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c/action" status: 200 len: 32 microversion: 2.1 time: 0.141217 Sep 06 22:44:34.113297 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 112/230] 10.222.0.39 () {60 vars in 1278 bytes} [Tue Sep 6 22:44:33 2022] POST /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c/action => generated 32 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 06 22:44:34.127018 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-897e537e-7a8d-48df-ae2f-ecefcbc70dbb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:34.127855 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-897e537e-7a8d-48df-ae2f-ecefcbc70dbb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 5bcd7a9d-c2c8-489c-9827-b6be1508d63c] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:34.134536 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-897e537e-7a8d-48df-ae2f-ecefcbc70dbb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:34.135087 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-897e537e-7a8d-48df-ae2f-ecefcbc70dbb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:34.135588 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-897e537e-7a8d-48df-ae2f-ecefcbc70dbb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:34.136328 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-897e537e-7a8d-48df-ae2f-ecefcbc70dbb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:34.137032 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-897e537e-7a8d-48df-ae2f-ecefcbc70dbb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:34.137502 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-897e537e-7a8d-48df-ae2f-ecefcbc70dbb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:34.469891 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-897e537e-7a8d-48df-ae2f-ecefcbc70dbb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:34.486070 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-897e537e-7a8d-48df-ae2f-ecefcbc70dbb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c" status: 200 len: 1522 microversion: 2.1 time: 0.365457 Sep 06 22:44:34.493045 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 119/231] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:34 2022] GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:35.057136 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8643a2d4-3b06-4932-97df-b737078128c9 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:35.059232 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8643a2d4-3b06-4932-97df-b737078128c9 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c9f58e44-e53c-4224-9b62-a3c23ba54ade] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:35.068790 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8643a2d4-3b06-4932-97df-b737078128c9 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:35.069538 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8643a2d4-3b06-4932-97df-b737078128c9 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:35.070071 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8643a2d4-3b06-4932-97df-b737078128c9 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:35.071458 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8643a2d4-3b06-4932-97df-b737078128c9 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:35.071973 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8643a2d4-3b06-4932-97df-b737078128c9 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:35.072401 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8643a2d4-3b06-4932-97df-b737078128c9 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:35.471575 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8643a2d4-3b06-4932-97df-b737078128c9 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8036279ef4384bdbfa8c37e46a1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebbea5186774c59942358c1fc284fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:35.481701 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8643a2d4-3b06-4932-97df-b737078128c9 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade" status: 200 len: 1319 microversion: 2.1 time: 0.430307 Sep 06 22:44:35.482259 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 113/232] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:35 2022] GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade => generated 1319 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:35.515541 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a5fe704b-21b0-4983-a9dc-2840314bb591 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:35.517580 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-a5fe704b-21b0-4983-a9dc-2840314bb591 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 5bcd7a9d-c2c8-489c-9827-b6be1508d63c] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:35.524806 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a5fe704b-21b0-4983-a9dc-2840314bb591 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:35.525303 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a5fe704b-21b0-4983-a9dc-2840314bb591 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:35.525957 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a5fe704b-21b0-4983-a9dc-2840314bb591 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:35.526779 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a5fe704b-21b0-4983-a9dc-2840314bb591 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:35.527300 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a5fe704b-21b0-4983-a9dc-2840314bb591 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:35.527780 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a5fe704b-21b0-4983-a9dc-2840314bb591 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:35.695669 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-bbde552f-dd49-4f37-ab94-23b3c423164e req-7a78350a-af34-4852-be13-00391e4fe22a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9f58e44-e53c-4224-9b62-a3c23ba54ade", "tag": "a21dfb14-4ae3-4c83-a2bc-bb4f7e665bbc"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:44:35.718151 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-bbde552f-dd49-4f37-ab94-23b3c423164e req-7a78350a-af34-4852-be13-00391e4fe22a service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:35.719119 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-bbde552f-dd49-4f37-ab94-23b3c423164e req-7a78350a-af34-4852-be13-00391e4fe22a service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:35.721355 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-bbde552f-dd49-4f37-ab94-23b3c423164e req-7a78350a-af34-4852-be13-00391e4fe22a service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:35.740044 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-bbde552f-dd49-4f37-ab94-23b3c423164e req-7a78350a-af34-4852-be13-00391e4fe22a service nova] Creating event network-changed:a21dfb14-4ae3-4c83-a2bc-bb4f7e665bbc for instance c9f58e44-e53c-4224-9b62-a3c23ba54ade on hv-cinder-85220 Sep 06 22:44:35.745991 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-bbde552f-dd49-4f37-ab94-23b3c423164e req-7a78350a-af34-4852-be13-00391e4fe22a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055629 Sep 06 22:44:35.746877 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 114/233] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:44:35.801017 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-a5fe704b-21b0-4983-a9dc-2840314bb591 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:35.811312 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-a5fe704b-21b0-4983-a9dc-2840314bb591 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c" status: 200 len: 1522 microversion: 2.1 time: 0.299427 Sep 06 22:44:35.811996 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 120/234] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:35 2022] GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:36.319563 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7c10bc3a-6eb6-4a23-99ed-5229e2f38f2a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:36.322058 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7c10bc3a-6eb6-4a23-99ed-5229e2f38f2a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:36.331575 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7c10bc3a-6eb6-4a23-99ed-5229e2f38f2a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:36.332396 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7c10bc3a-6eb6-4a23-99ed-5229e2f38f2a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:36.333041 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7c10bc3a-6eb6-4a23-99ed-5229e2f38f2a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:36.334917 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7c10bc3a-6eb6-4a23-99ed-5229e2f38f2a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:36.335559 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7c10bc3a-6eb6-4a23-99ed-5229e2f38f2a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:36.336176 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7c10bc3a-6eb6-4a23-99ed-5229e2f38f2a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:36.367087 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7c10bc3a-6eb6-4a23-99ed-5229e2f38f2a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd/ips" status: 200 len: 151 microversion: 2.20 time: 0.054537 Sep 06 22:44:36.368168 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 115/235] 10.222.0.39 () {60 vars in 1289 bytes} [Tue Sep 6 22:44:36 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd/ips => generated 151 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 22:44:36.505514 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-893e4d1e-7922-429f-b44b-05cb56439cc8 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:36.506335 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-893e4d1e-7922-429f-b44b-05cb56439cc8 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c9f58e44-e53c-4224-9b62-a3c23ba54ade] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:36.514026 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-893e4d1e-7922-429f-b44b-05cb56439cc8 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:36.514720 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-893e4d1e-7922-429f-b44b-05cb56439cc8 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:36.515458 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-893e4d1e-7922-429f-b44b-05cb56439cc8 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:36.517006 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-893e4d1e-7922-429f-b44b-05cb56439cc8 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:36.518219 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-893e4d1e-7922-429f-b44b-05cb56439cc8 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:36.518962 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-893e4d1e-7922-429f-b44b-05cb56439cc8 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:36.685027 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-893e4d1e-7922-429f-b44b-05cb56439cc8 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8036279ef4384bdbfa8c37e46a1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebbea5186774c59942358c1fc284fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:36.701971 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-893e4d1e-7922-429f-b44b-05cb56439cc8 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade" status: 200 len: 1319 microversion: 2.1 time: 0.200117 Sep 06 22:44:36.703066 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 121/236] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:36 2022] GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:36.835018 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6f4b6c61-6318-473b-9cac-272700b24788 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:36.835635 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6f4b6c61-6318-473b-9cac-272700b24788 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 5bcd7a9d-c2c8-489c-9827-b6be1508d63c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:36.841602 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f4b6c61-6318-473b-9cac-272700b24788 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:36.842284 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f4b6c61-6318-473b-9cac-272700b24788 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:36.842996 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f4b6c61-6318-473b-9cac-272700b24788 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:36.844541 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f4b6c61-6318-473b-9cac-272700b24788 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:36.845339 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f4b6c61-6318-473b-9cac-272700b24788 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:36.845952 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f4b6c61-6318-473b-9cac-272700b24788 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:37.030919 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6f4b6c61-6318-473b-9cac-272700b24788 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:37.039620 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6f4b6c61-6318-473b-9cac-272700b24788 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c" status: 200 len: 1522 microversion: 2.1 time: 0.208571 Sep 06 22:44:37.040201 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 116/237] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:36 2022] GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:37.726663 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-bc440220-9827-4bb4-b7ba-266909257f6e tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:37.727294 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-bc440220-9827-4bb4-b7ba-266909257f6e tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c9f58e44-e53c-4224-9b62-a3c23ba54ade] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:37.734833 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bc440220-9827-4bb4-b7ba-266909257f6e tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:37.735322 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bc440220-9827-4bb4-b7ba-266909257f6e tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:37.735938 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bc440220-9827-4bb4-b7ba-266909257f6e tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:37.736629 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bc440220-9827-4bb4-b7ba-266909257f6e tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:37.737207 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bc440220-9827-4bb4-b7ba-266909257f6e tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:37.737620 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bc440220-9827-4bb4-b7ba-266909257f6e tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:37.935809 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-bc440220-9827-4bb4-b7ba-266909257f6e tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8036279ef4384bdbfa8c37e46a1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebbea5186774c59942358c1fc284fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:37.948934 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-bc440220-9827-4bb4-b7ba-266909257f6e tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade" status: 200 len: 1319 microversion: 2.1 time: 0.226057 Sep 06 22:44:37.955926 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 122/238] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:37 2022] GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:38.062722 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4d390357-6252-4330-8eff-c9c0a0c42d37 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:38.063335 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4d390357-6252-4330-8eff-c9c0a0c42d37 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 5bcd7a9d-c2c8-489c-9827-b6be1508d63c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:38.070163 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d390357-6252-4330-8eff-c9c0a0c42d37 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:38.070766 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d390357-6252-4330-8eff-c9c0a0c42d37 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:38.071325 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d390357-6252-4330-8eff-c9c0a0c42d37 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:38.072030 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d390357-6252-4330-8eff-c9c0a0c42d37 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:38.072504 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d390357-6252-4330-8eff-c9c0a0c42d37 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:38.073147 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d390357-6252-4330-8eff-c9c0a0c42d37 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:38.221426 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4d390357-6252-4330-8eff-c9c0a0c42d37 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:38.229206 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4d390357-6252-4330-8eff-c9c0a0c42d37 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c" status: 200 len: 1522 microversion: 2.1 time: 0.170304 Sep 06 22:44:38.229773 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 117/239] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:38 2022] GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:38.974368 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e5782950-dadd-47b3-8a88-79fc5f76d1df tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:44:38.974895 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e5782950-dadd-47b3-8a88-79fc5f76d1df tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:38.976886 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-bc9450e0-10cd-487a-9565-93de26dc143e tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:38.977520 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-bc9450e0-10cd-487a-9565-93de26dc143e tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c9f58e44-e53c-4224-9b62-a3c23ba54ade] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:38.981094 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e5782950-dadd-47b3-8a88-79fc5f76d1df tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:38.981571 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e5782950-dadd-47b3-8a88-79fc5f76d1df tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:38.982000 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e5782950-dadd-47b3-8a88-79fc5f76d1df tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:38.982684 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e5782950-dadd-47b3-8a88-79fc5f76d1df tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:38.983123 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e5782950-dadd-47b3-8a88-79fc5f76d1df tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:38.983559 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bc9450e0-10cd-487a-9565-93de26dc143e tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:38.983676 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e5782950-dadd-47b3-8a88-79fc5f76d1df tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:38.984029 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bc9450e0-10cd-487a-9565-93de26dc143e tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:38.985026 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bc9450e0-10cd-487a-9565-93de26dc143e tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:38.985803 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bc9450e0-10cd-487a-9565-93de26dc143e tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:38.986246 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bc9450e0-10cd-487a-9565-93de26dc143e tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:38.986657 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bc9450e0-10cd-487a-9565-93de26dc143e tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:39.007405 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-e5782950-dadd-47b3-8a88-79fc5f76d1df tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lazy-loading 'flavor' on Instance uuid 13ef5db2-b5d1-41af-8c93-2851abb0b6dd {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 22:44:39.126260 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-bc9450e0-10cd-487a-9565-93de26dc143e tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8036279ef4384bdbfa8c37e46a1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebbea5186774c59942358c1fc284fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:39.135074 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-bc9450e0-10cd-487a-9565-93de26dc143e tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade" status: 200 len: 1319 microversion: 2.1 time: 0.163683 Sep 06 22:44:39.135634 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 123/240] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:38 2022] GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:44:39.199657 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e5782950-dadd-47b3-8a88-79fc5f76d1df tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "POST /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd/action" status: 202 len: 0 microversion: 2.20 time: 0.229028 Sep 06 22:44:39.200284 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 118/241] 10.222.0.39 () {62 vars in 1319 bytes} [Tue Sep 6 22:44:38 2022] POST /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 06 22:44:39.209053 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-105cc1cc-9656-41d0-a1f0-6bfb6ff535f0 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:39.209794 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-105cc1cc-9656-41d0-a1f0-6bfb6ff535f0 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:39.215802 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-105cc1cc-9656-41d0-a1f0-6bfb6ff535f0 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:39.216400 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-105cc1cc-9656-41d0-a1f0-6bfb6ff535f0 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:39.216849 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-105cc1cc-9656-41d0-a1f0-6bfb6ff535f0 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:39.217578 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-105cc1cc-9656-41d0-a1f0-6bfb6ff535f0 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:39.218086 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-105cc1cc-9656-41d0-a1f0-6bfb6ff535f0 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:39.225489 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-105cc1cc-9656-41d0-a1f0-6bfb6ff535f0 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:39.256594 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-42762ae3-7c82-414d-b9df-33f2e56a7503 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:39.257508 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-42762ae3-7c82-414d-b9df-33f2e56a7503 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 5bcd7a9d-c2c8-489c-9827-b6be1508d63c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:39.266063 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-42762ae3-7c82-414d-b9df-33f2e56a7503 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:39.266904 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-42762ae3-7c82-414d-b9df-33f2e56a7503 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:39.267645 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-42762ae3-7c82-414d-b9df-33f2e56a7503 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:39.268646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-42762ae3-7c82-414d-b9df-33f2e56a7503 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:39.269134 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-42762ae3-7c82-414d-b9df-33f2e56a7503 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:39.269559 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-42762ae3-7c82-414d-b9df-33f2e56a7503 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:39.410953 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-105cc1cc-9656-41d0-a1f0-6bfb6ff535f0 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:39.424337 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-105cc1cc-9656-41d0-a1f0-6bfb6ff535f0 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:39.426279 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-105cc1cc-9656-41d0-a1f0-6bfb6ff535f0 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:39.428098 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-105cc1cc-9656-41d0-a1f0-6bfb6ff535f0 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1723 microversion: 2.20 time: 0.223000 Sep 06 22:44:39.429443 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 124/242] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:44:39 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:44:39.446138 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-42762ae3-7c82-414d-b9df-33f2e56a7503 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:39.456218 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-42762ae3-7c82-414d-b9df-33f2e56a7503 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c" status: 200 len: 1522 microversion: 2.1 time: 0.205986 Sep 06 22:44:39.457228 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 119/243] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:39 2022] GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:39.725768 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f99a6e40-d5ae-47e8-8536-f8eccd0b509f tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-401148693", "imageRef": "93326d5e-4826-431e-9ad1-6ee2d44e48d9", "flavorRef": "452"}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:44:39.776275 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.network.neutron [None req-f99a6e40-d5ae-47e8-8536-f8eccd0b509f tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] validate_networks() for None {{(pid=127087) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 22:44:40.050784 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-f99a6e40-d5ae-47e8-8536-f8eccd0b509f tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Flavor limits 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 22:44:40.051363 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-f99a6e40-d5ae-47e8-8536-f8eccd0b509f tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Image limits 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 22:44:40.051643 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-f99a6e40-d5ae-47e8-8536-f8eccd0b509f tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Flavor pref 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 22:44:40.052075 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-f99a6e40-d5ae-47e8-8536-f8eccd0b509f tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Image pref 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 22:44:40.052472 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-f99a6e40-d5ae-47e8-8536-f8eccd0b509f tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 22:44:40.061253 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f99a6e40-d5ae-47e8-8536-f8eccd0b509f tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:40.061725 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f99a6e40-d5ae-47e8-8536-f8eccd0b509f tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:40.062148 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f99a6e40-d5ae-47e8-8536-f8eccd0b509f tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:40.063764 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f99a6e40-d5ae-47e8-8536-f8eccd0b509f tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:40.064212 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f99a6e40-d5ae-47e8-8536-f8eccd0b509f tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:40.064631 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f99a6e40-d5ae-47e8-8536-f8eccd0b509f tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:40.081044 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-f99a6e40-d5ae-47e8-8536-f8eccd0b509f tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Getting quotas for project ad0aee19677643cbbaeff056c8e5a2c4. Resources: {'instances', 'ram', 'cores'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 22:44:40.084935 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-f99a6e40-d5ae-47e8-8536-f8eccd0b509f tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Getting quotas for user 1e73bc19084a4bab9727b9dda49b37c6 and project ad0aee19677643cbbaeff056c8e5a2c4. Resources: {'instances', 'ram', 'cores'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 22:44:40.095797 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-f99a6e40-d5ae-47e8-8536-f8eccd0b509f tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Going to run 1 instances... {{(pid=127087) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 22:44:40.098111 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-f99a6e40-d5ae-47e8-8536-f8eccd0b509f tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] [instance: 19245a9c-8e4c-406f-b0b8-1afbb5895c16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='93326d5e-4826-431e-9ad1-6ee2d44e48d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 22:44:40.145610 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-f99a6e40-d5ae-47e8-8536-f8eccd0b509f tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.423388 Sep 06 22:44:40.146250 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 125/244] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Sep 6 22:44:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 425 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 22:44:40.157618 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4c19925b-1097-4fa2-8302-ceeee2851f22 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:40.158251 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4c19925b-1097-4fa2-8302-ceeee2851f22 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] [instance: 19245a9c-8e4c-406f-b0b8-1afbb5895c16] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:40.158574 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-534ca6f0-89d0-4a8e-ab28-e04a1c1b009b tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:40.159177 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-534ca6f0-89d0-4a8e-ab28-e04a1c1b009b tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c9f58e44-e53c-4224-9b62-a3c23ba54ade] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:40.165547 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-534ca6f0-89d0-4a8e-ab28-e04a1c1b009b tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:40.166030 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-534ca6f0-89d0-4a8e-ab28-e04a1c1b009b tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:40.166461 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-534ca6f0-89d0-4a8e-ab28-e04a1c1b009b tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:40.167500 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-534ca6f0-89d0-4a8e-ab28-e04a1c1b009b tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:40.167699 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-534ca6f0-89d0-4a8e-ab28-e04a1c1b009b tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:40.168100 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-534ca6f0-89d0-4a8e-ab28-e04a1c1b009b tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:40.216742 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4c19925b-1097-4fa2-8302-ceeee2851f22 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e73bc19084a4bab9727b9dda49b37c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0aee19677643cbbaeff056c8e5a2c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:40.226524 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4c19925b-1097-4fa2-8302-ceeee2851f22 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] 10.222.0.39 "GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16" status: 200 len: 1214 microversion: 2.1 time: 0.071022 Sep 06 22:44:40.226524 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 120/245] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:40 2022] GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:40.320236 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-534ca6f0-89d0-4a8e-ab28-e04a1c1b009b tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8036279ef4384bdbfa8c37e46a1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebbea5186774c59942358c1fc284fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:40.327855 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-534ca6f0-89d0-4a8e-ab28-e04a1c1b009b tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade" status: 200 len: 1319 microversion: 2.1 time: 0.173611 Sep 06 22:44:40.329043 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 126/246] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:40 2022] GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:44:40.455311 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-49f759ad-1784-4f36-913d-521c3067ae93 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:40.455928 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-49f759ad-1784-4f36-913d-521c3067ae93 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:40.461972 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-49f759ad-1784-4f36-913d-521c3067ae93 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:40.462451 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-49f759ad-1784-4f36-913d-521c3067ae93 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:40.462877 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-49f759ad-1784-4f36-913d-521c3067ae93 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:40.463597 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-49f759ad-1784-4f36-913d-521c3067ae93 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:40.464047 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-49f759ad-1784-4f36-913d-521c3067ae93 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:40.464457 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-49f759ad-1784-4f36-913d-521c3067ae93 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:40.480315 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-282d785c-e74e-4aac-a347-b5287a152675 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:40.481044 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-282d785c-e74e-4aac-a347-b5287a152675 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 5bcd7a9d-c2c8-489c-9827-b6be1508d63c] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:40.484144 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:44:40.487391 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-282d785c-e74e-4aac-a347-b5287a152675 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:40.487975 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-282d785c-e74e-4aac-a347-b5287a152675 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:40.489307 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-282d785c-e74e-4aac-a347-b5287a152675 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:40.490104 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-282d785c-e74e-4aac-a347-b5287a152675 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:40.490720 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-282d785c-e74e-4aac-a347-b5287a152675 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:40.491180 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-282d785c-e74e-4aac-a347-b5287a152675 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:40.693564 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-49f759ad-1784-4f36-913d-521c3067ae93 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:40.697088 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-282d785c-e74e-4aac-a347-b5287a152675 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:40.702777 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-49f759ad-1784-4f36-913d-521c3067ae93 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:40.704483 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-49f759ad-1784-4f36-913d-521c3067ae93 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:40.705965 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-49f759ad-1784-4f36-913d-521c3067ae93 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1723 microversion: 2.20 time: 0.255268 Sep 06 22:44:40.706713 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 121/247] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:44:40 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:44:40.706974 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-282d785c-e74e-4aac-a347-b5287a152675 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c" status: 200 len: 1522 microversion: 2.1 time: 0.231401 Sep 06 22:44:40.708799 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 127/248] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:40 2022] GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:44:41.121548 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-ccc95d16-a54a-4893-bbe0-962d83256911 req-d34ce248-42ac-46eb-bfc5-0b3a104b7b65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f58e44-e53c-4224-9b62-a3c23ba54ade", "name": "network-vif-plugged", "status": "completed", "tag": "a21dfb14-4ae3-4c83-a2bc-bb4f7e665bbc"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:44:41.133822 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-ccc95d16-a54a-4893-bbe0-962d83256911 req-d34ce248-42ac-46eb-bfc5-0b3a104b7b65 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:41.134864 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-ccc95d16-a54a-4893-bbe0-962d83256911 req-d34ce248-42ac-46eb-bfc5-0b3a104b7b65 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:41.136433 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-ccc95d16-a54a-4893-bbe0-962d83256911 req-d34ce248-42ac-46eb-bfc5-0b3a104b7b65 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:41.153026 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-ccc95d16-a54a-4893-bbe0-962d83256911 req-d34ce248-42ac-46eb-bfc5-0b3a104b7b65 service nova] Creating event network-vif-plugged:a21dfb14-4ae3-4c83-a2bc-bb4f7e665bbc for instance c9f58e44-e53c-4224-9b62-a3c23ba54ade on hv-cinder-85220 Sep 06 22:44:41.159342 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-ccc95d16-a54a-4893-bbe0-962d83256911 req-d34ce248-42ac-46eb-bfc5-0b3a104b7b65 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041924 Sep 06 22:44:41.160571 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 122/249] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:44:41.248655 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e11f5de1-cc53-4b8f-a632-2f9144ee223a tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:41.249404 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e11f5de1-cc53-4b8f-a632-2f9144ee223a tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] [instance: 19245a9c-8e4c-406f-b0b8-1afbb5895c16] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:41.255942 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e11f5de1-cc53-4b8f-a632-2f9144ee223a tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:41.256434 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e11f5de1-cc53-4b8f-a632-2f9144ee223a tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:41.256889 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e11f5de1-cc53-4b8f-a632-2f9144ee223a tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:41.257666 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e11f5de1-cc53-4b8f-a632-2f9144ee223a tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:41.258250 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e11f5de1-cc53-4b8f-a632-2f9144ee223a tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:41.258817 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e11f5de1-cc53-4b8f-a632-2f9144ee223a tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:41.331714 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e11f5de1-cc53-4b8f-a632-2f9144ee223a tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e73bc19084a4bab9727b9dda49b37c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0aee19677643cbbaeff056c8e5a2c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:41.339260 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e11f5de1-cc53-4b8f-a632-2f9144ee223a tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] 10.222.0.39 "GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16" status: 200 len: 1266 microversion: 2.1 time: 0.094589 Sep 06 22:44:41.339880 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 128/250] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:41 2022] GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16 => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:44:41.351553 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9ba19a2f-7e82-4ab6-b3f8-2b03b6bc9fa4 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:41.352400 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9ba19a2f-7e82-4ab6-b3f8-2b03b6bc9fa4 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c9f58e44-e53c-4224-9b62-a3c23ba54ade] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:41.359949 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ba19a2f-7e82-4ab6-b3f8-2b03b6bc9fa4 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:41.360652 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ba19a2f-7e82-4ab6-b3f8-2b03b6bc9fa4 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:41.361272 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ba19a2f-7e82-4ab6-b3f8-2b03b6bc9fa4 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:41.362264 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ba19a2f-7e82-4ab6-b3f8-2b03b6bc9fa4 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:41.362915 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ba19a2f-7e82-4ab6-b3f8-2b03b6bc9fa4 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:41.363508 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ba19a2f-7e82-4ab6-b3f8-2b03b6bc9fa4 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:41.400561 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-421b2554-e1c6-4e6c-8a5b-a084f5d62e74 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:41.401144 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-421b2554-e1c6-4e6c-8a5b-a084f5d62e74 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:41.407383 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-421b2554-e1c6-4e6c-8a5b-a084f5d62e74 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:41.407865 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-421b2554-e1c6-4e6c-8a5b-a084f5d62e74 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:41.408292 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-421b2554-e1c6-4e6c-8a5b-a084f5d62e74 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:41.409006 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-421b2554-e1c6-4e6c-8a5b-a084f5d62e74 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:41.409664 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-421b2554-e1c6-4e6c-8a5b-a084f5d62e74 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:41.410334 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-421b2554-e1c6-4e6c-8a5b-a084f5d62e74 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:41.413961 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:44:41.426509 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=100 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:44:41.436998 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-421b2554-e1c6-4e6c-8a5b-a084f5d62e74 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5/ips" status: 200 len: 146 microversion: 2.1 time: 0.040161 Sep 06 22:44:41.438176 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 129/251] 10.222.0.39 () {58 vars in 1248 bytes} [Tue Sep 6 22:44:41 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:44:41.506155 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9ba19a2f-7e82-4ab6-b3f8-2b03b6bc9fa4 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8036279ef4384bdbfa8c37e46a1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebbea5186774c59942358c1fc284fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:41.514631 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9ba19a2f-7e82-4ab6-b3f8-2b03b6bc9fa4 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade" status: 200 len: 1319 microversion: 2.1 time: 0.167219 Sep 06 22:44:41.517801 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 123/252] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:41 2022] GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:41.733249 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-99320580-af3b-46c9-9868-87550bc73c02 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:41.734802 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-99320580-af3b-46c9-9868-87550bc73c02 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:41.743274 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ebeaaadc-76b3-4232-86ab-d4ce74d6c9a7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:41.744347 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ebeaaadc-76b3-4232-86ab-d4ce74d6c9a7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 5bcd7a9d-c2c8-489c-9827-b6be1508d63c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:41.754248 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ebeaaadc-76b3-4232-86ab-d4ce74d6c9a7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:41.755990 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-99320580-af3b-46c9-9868-87550bc73c02 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:41.756543 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ebeaaadc-76b3-4232-86ab-d4ce74d6c9a7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:41.757079 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ebeaaadc-76b3-4232-86ab-d4ce74d6c9a7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:41.757874 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ebeaaadc-76b3-4232-86ab-d4ce74d6c9a7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:41.758457 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-99320580-af3b-46c9-9868-87550bc73c02 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:41.758948 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-99320580-af3b-46c9-9868-87550bc73c02 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:41.759427 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ebeaaadc-76b3-4232-86ab-d4ce74d6c9a7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:41.760202 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-99320580-af3b-46c9-9868-87550bc73c02 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:41.760690 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ebeaaadc-76b3-4232-86ab-d4ce74d6c9a7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:41.763646 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-99320580-af3b-46c9-9868-87550bc73c02 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:41.764474 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-99320580-af3b-46c9-9868-87550bc73c02 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:42.058970 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ebeaaadc-76b3-4232-86ab-d4ce74d6c9a7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:42.068954 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ebeaaadc-76b3-4232-86ab-d4ce74d6c9a7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c" status: 200 len: 1522 microversion: 2.1 time: 0.330295 Sep 06 22:44:42.069127 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-99320580-af3b-46c9-9868-87550bc73c02 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:42.069565 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 124/253] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:41 2022] GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:44:42.091622 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-99320580-af3b-46c9-9868-87550bc73c02 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:42.093094 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-99320580-af3b-46c9-9868-87550bc73c02 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:42.094671 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-99320580-af3b-46c9-9868-87550bc73c02 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1723 microversion: 2.20 time: 0.365031 Sep 06 22:44:42.095278 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 130/254] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:44:41 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1723 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:44:42.364195 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-590cd019-080f-41da-92ed-035e8943cb94 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:42.365070 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-590cd019-080f-41da-92ed-035e8943cb94 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] [instance: 19245a9c-8e4c-406f-b0b8-1afbb5895c16] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:42.372039 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-590cd019-080f-41da-92ed-035e8943cb94 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:42.372534 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-590cd019-080f-41da-92ed-035e8943cb94 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:42.373000 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-590cd019-080f-41da-92ed-035e8943cb94 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:42.374018 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-590cd019-080f-41da-92ed-035e8943cb94 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:42.374339 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-590cd019-080f-41da-92ed-035e8943cb94 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:42.375011 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-590cd019-080f-41da-92ed-035e8943cb94 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:42.456157 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-590cd019-080f-41da-92ed-035e8943cb94 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e73bc19084a4bab9727b9dda49b37c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0aee19677643cbbaeff056c8e5a2c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:42.464006 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-590cd019-080f-41da-92ed-035e8943cb94 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] 10.222.0.39 "GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16" status: 200 len: 1272 microversion: 2.1 time: 0.104011 Sep 06 22:44:42.464816 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 125/255] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:42 2022] GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16 => generated 1272 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:42.540772 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-759982a9-b3b3-416a-a23d-a9a56a71ec5d tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:42.541392 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-759982a9-b3b3-416a-a23d-a9a56a71ec5d tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c9f58e44-e53c-4224-9b62-a3c23ba54ade] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:42.548444 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-759982a9-b3b3-416a-a23d-a9a56a71ec5d tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:42.549059 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-759982a9-b3b3-416a-a23d-a9a56a71ec5d tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:42.549588 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-759982a9-b3b3-416a-a23d-a9a56a71ec5d tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:42.550342 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-759982a9-b3b3-416a-a23d-a9a56a71ec5d tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:42.551132 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-759982a9-b3b3-416a-a23d-a9a56a71ec5d tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:42.551558 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-759982a9-b3b3-416a-a23d-a9a56a71ec5d tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:42.799407 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-759982a9-b3b3-416a-a23d-a9a56a71ec5d tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8036279ef4384bdbfa8c37e46a1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebbea5186774c59942358c1fc284fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:42.808100 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-759982a9-b3b3-416a-a23d-a9a56a71ec5d tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade" status: 200 len: 1319 microversion: 2.1 time: 0.271182 Sep 06 22:44:42.809132 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 131/256] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:42 2022] GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade => generated 1319 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:43.093597 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0c91121b-4480-4375-a10b-c723d9b4ed8e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:43.094555 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0c91121b-4480-4375-a10b-c723d9b4ed8e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 5bcd7a9d-c2c8-489c-9827-b6be1508d63c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:43.107625 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0c91121b-4480-4375-a10b-c723d9b4ed8e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:43.108118 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0c91121b-4480-4375-a10b-c723d9b4ed8e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:43.108551 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0c91121b-4480-4375-a10b-c723d9b4ed8e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:43.110011 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0c91121b-4480-4375-a10b-c723d9b4ed8e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:43.110455 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0c91121b-4480-4375-a10b-c723d9b4ed8e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:43.111067 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0c91121b-4480-4375-a10b-c723d9b4ed8e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:43.124997 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9d567330-8a8f-4468-8aef-834a1a5bdfe6 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:43.126540 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9d567330-8a8f-4468-8aef-834a1a5bdfe6 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:43.135568 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9d567330-8a8f-4468-8aef-834a1a5bdfe6 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:43.136492 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9d567330-8a8f-4468-8aef-834a1a5bdfe6 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:43.137447 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9d567330-8a8f-4468-8aef-834a1a5bdfe6 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:43.138656 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9d567330-8a8f-4468-8aef-834a1a5bdfe6 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:43.139302 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9d567330-8a8f-4468-8aef-834a1a5bdfe6 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:43.139905 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9d567330-8a8f-4468-8aef-834a1a5bdfe6 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:43.492183 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0c91121b-4480-4375-a10b-c723d9b4ed8e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:43.494831 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9d567330-8a8f-4468-8aef-834a1a5bdfe6 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:43.504278 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9d567330-8a8f-4468-8aef-834a1a5bdfe6 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:43.505812 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9d567330-8a8f-4468-8aef-834a1a5bdfe6 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:43.507106 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9d567330-8a8f-4468-8aef-834a1a5bdfe6 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1723 microversion: 2.20 time: 0.388100 Sep 06 22:44:43.507539 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0c91121b-4480-4375-a10b-c723d9b4ed8e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c" status: 200 len: 1522 microversion: 2.1 time: 0.417168 Sep 06 22:44:43.509614 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 126/257] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:43 2022] GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c => generated 1522 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:43.516420 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3613690d-860b-4a3c-8c1a-04f785fca37f tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:43.516914 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 132/258] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:44:43 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1723 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:44:43.517422 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3613690d-860b-4a3c-8c1a-04f785fca37f tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] [instance: 19245a9c-8e4c-406f-b0b8-1afbb5895c16] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:43.540619 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3613690d-860b-4a3c-8c1a-04f785fca37f tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:43.541393 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3613690d-860b-4a3c-8c1a-04f785fca37f tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:43.542230 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3613690d-860b-4a3c-8c1a-04f785fca37f tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:43.558671 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3613690d-860b-4a3c-8c1a-04f785fca37f tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:43.562470 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3613690d-860b-4a3c-8c1a-04f785fca37f tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:43.563582 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3613690d-860b-4a3c-8c1a-04f785fca37f tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:43.832269 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-78302472-d794-4487-9df0-a15a52193ace tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:43.833052 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-78302472-d794-4487-9df0-a15a52193ace tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c9f58e44-e53c-4224-9b62-a3c23ba54ade] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:43.839364 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-78302472-d794-4487-9df0-a15a52193ace tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:43.840161 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-78302472-d794-4487-9df0-a15a52193ace tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:43.840771 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-78302472-d794-4487-9df0-a15a52193ace tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:43.841473 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-78302472-d794-4487-9df0-a15a52193ace tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:43.841967 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-78302472-d794-4487-9df0-a15a52193ace tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:43.842555 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-78302472-d794-4487-9df0-a15a52193ace tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:43.867747 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3613690d-860b-4a3c-8c1a-04f785fca37f tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e73bc19084a4bab9727b9dda49b37c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0aee19677643cbbaeff056c8e5a2c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:43.882309 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3613690d-860b-4a3c-8c1a-04f785fca37f tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] 10.222.0.39 "GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16" status: 200 len: 1314 microversion: 2.1 time: 0.371444 Sep 06 22:44:43.883461 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 127/259] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:43 2022] GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16 => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:44.090892 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-78302472-d794-4487-9df0-a15a52193ace tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8036279ef4384bdbfa8c37e46a1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebbea5186774c59942358c1fc284fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:44.100529 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-78302472-d794-4487-9df0-a15a52193ace tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade" status: 200 len: 1507 microversion: 2.1 time: 0.272598 Sep 06 22:44:44.101251 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 133/260] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:43 2022] GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade => generated 1507 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:44:44.289853 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-60d1bb06-1316-4ae3-8bcc-1512d484a862 req-365dbecb-dbab-4738-b702-16685999e992 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19245a9c-8e4c-406f-b0b8-1afbb5895c16", "tag": "e65f96cc-fdef-4ae2-981c-67acf6f8f5ba"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:44:44.303371 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-60d1bb06-1316-4ae3-8bcc-1512d484a862 req-365dbecb-dbab-4738-b702-16685999e992 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:44.304028 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-60d1bb06-1316-4ae3-8bcc-1512d484a862 req-365dbecb-dbab-4738-b702-16685999e992 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:44.304610 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-60d1bb06-1316-4ae3-8bcc-1512d484a862 req-365dbecb-dbab-4738-b702-16685999e992 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:44.321466 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-60d1bb06-1316-4ae3-8bcc-1512d484a862 req-365dbecb-dbab-4738-b702-16685999e992 service nova] Creating event network-changed:e65f96cc-fdef-4ae2-981c-67acf6f8f5ba for instance 19245a9c-8e4c-406f-b0b8-1afbb5895c16 on hv-cinder-85220 Sep 06 22:44:44.327086 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-60d1bb06-1316-4ae3-8bcc-1512d484a862 req-365dbecb-dbab-4738-b702-16685999e992 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043443 Sep 06 22:44:44.328571 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 128/261] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 22:44:44.562140 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-dcf1d3b0-9f2e-4f03-8546-7865a6bb7e5d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:44.563001 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-dcf1d3b0-9f2e-4f03-8546-7865a6bb7e5d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 5bcd7a9d-c2c8-489c-9827-b6be1508d63c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:44.563388 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-99992657-ef44-4761-b4e0-e28dccb91e33 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:44.564281 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-99992657-ef44-4761-b4e0-e28dccb91e33 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:44.571913 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dcf1d3b0-9f2e-4f03-8546-7865a6bb7e5d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:44.573463 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dcf1d3b0-9f2e-4f03-8546-7865a6bb7e5d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:44.574048 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dcf1d3b0-9f2e-4f03-8546-7865a6bb7e5d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:44.574946 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dcf1d3b0-9f2e-4f03-8546-7865a6bb7e5d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:44.575539 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dcf1d3b0-9f2e-4f03-8546-7865a6bb7e5d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:44.576880 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-dcf1d3b0-9f2e-4f03-8546-7865a6bb7e5d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:44.581224 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-99992657-ef44-4761-b4e0-e28dccb91e33 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:44.581971 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-99992657-ef44-4761-b4e0-e28dccb91e33 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:44.582642 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-99992657-ef44-4761-b4e0-e28dccb91e33 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:44.583624 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-99992657-ef44-4761-b4e0-e28dccb91e33 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:44.584175 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-99992657-ef44-4761-b4e0-e28dccb91e33 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:44.584838 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-99992657-ef44-4761-b4e0-e28dccb91e33 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:44.984115 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-99992657-ef44-4761-b4e0-e28dccb91e33 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:44.990355 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-dcf1d3b0-9f2e-4f03-8546-7865a6bb7e5d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:44.994822 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-99992657-ef44-4761-b4e0-e28dccb91e33 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:44.998822 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-dcf1d3b0-9f2e-4f03-8546-7865a6bb7e5d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c" status: 200 len: 1522 microversion: 2.1 time: 0.441936 Sep 06 22:44:45.001172 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 129/262] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:44 2022] GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c => generated 1522 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:45.006714 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6d948336-ac55-4837-aaa5-c45867c266cb tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a967eca1-c0ec-4dfe-bbbe-fd20be3dc6f7"}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:44:45.009905 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6d948336-ac55-4837-aaa5-c45867c266cb tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:45.018620 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-99992657-ef44-4761-b4e0-e28dccb91e33 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:45.019389 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6d948336-ac55-4837-aaa5-c45867c266cb tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:45.020617 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6d948336-ac55-4837-aaa5-c45867c266cb tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:45.021715 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-99992657-ef44-4761-b4e0-e28dccb91e33 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1723 microversion: 2.20 time: 0.465485 Sep 06 22:44:45.022379 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6d948336-ac55-4837-aaa5-c45867c266cb tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:45.023335 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 134/263] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:44:44 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1723 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:44:45.023782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6d948336-ac55-4837-aaa5-c45867c266cb tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:45.025357 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6d948336-ac55-4837-aaa5-c45867c266cb tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:45.026598 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6d948336-ac55-4837-aaa5-c45867c266cb tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:45.035699 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-5d30d35f-05c2-4618-bad7-e0668efaafae tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:45.036596 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-5d30d35f-05c2-4618-bad7-e0668efaafae tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] [instance: 19245a9c-8e4c-406f-b0b8-1afbb5895c16] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:45.044471 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5d30d35f-05c2-4618-bad7-e0668efaafae tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:45.045091 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5d30d35f-05c2-4618-bad7-e0668efaafae tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:45.045690 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5d30d35f-05c2-4618-bad7-e0668efaafae tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:45.046565 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5d30d35f-05c2-4618-bad7-e0668efaafae tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:45.047071 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5d30d35f-05c2-4618-bad7-e0668efaafae tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:45.047879 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5d30d35f-05c2-4618-bad7-e0668efaafae tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:45.234764 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-5d30d35f-05c2-4618-bad7-e0668efaafae tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e73bc19084a4bab9727b9dda49b37c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0aee19677643cbbaeff056c8e5a2c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:45.242743 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-5d30d35f-05c2-4618-bad7-e0668efaafae tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] 10.222.0.39 "GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16" status: 200 len: 1314 microversion: 2.1 time: 0.217555 Sep 06 22:44:45.243394 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 135/264] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:45 2022] GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:46.028228 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6e7d0768-65f8-4e80-8e35-66d3aa5b4bd3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:46.028971 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-6e7d0768-65f8-4e80-8e35-66d3aa5b4bd3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 5bcd7a9d-c2c8-489c-9827-b6be1508d63c] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:46.036359 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6e7d0768-65f8-4e80-8e35-66d3aa5b4bd3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:46.037130 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6e7d0768-65f8-4e80-8e35-66d3aa5b4bd3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:46.037624 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6e7d0768-65f8-4e80-8e35-66d3aa5b4bd3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:46.038277 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6e7d0768-65f8-4e80-8e35-66d3aa5b4bd3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:46.038882 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6e7d0768-65f8-4e80-8e35-66d3aa5b4bd3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:46.039489 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6e7d0768-65f8-4e80-8e35-66d3aa5b4bd3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:46.306341 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6d948336-ac55-4837-aaa5-c45867c266cb tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "POST /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.301413 Sep 06 22:44:46.308135 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 130/265] 10.222.0.39 () {60 vars in 1323 bytes} [Tue Sep 6 22:44:45 2022] POST /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5/os-volume_attachments => generated 194 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:44:46.332403 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f68300c3-9858-4b4a-9822-5ead229fb5b3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:46.335126 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f68300c3-9858-4b4a-9822-5ead229fb5b3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:46.344800 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:44:46.347945 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f68300c3-9858-4b4a-9822-5ead229fb5b3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:46.348654 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f68300c3-9858-4b4a-9822-5ead229fb5b3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:46.349272 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f68300c3-9858-4b4a-9822-5ead229fb5b3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:46.351898 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f68300c3-9858-4b4a-9822-5ead229fb5b3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:46.351898 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f68300c3-9858-4b4a-9822-5ead229fb5b3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:46.351898 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f68300c3-9858-4b4a-9822-5ead229fb5b3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:46.402048 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6e7d0768-65f8-4e80-8e35-66d3aa5b4bd3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:46.424054 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-6e7d0768-65f8-4e80-8e35-66d3aa5b4bd3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c" status: 200 len: 1522 microversion: 2.1 time: 0.399980 Sep 06 22:44:46.424673 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 136/266] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:46 2022] GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c => generated 1522 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:46.450078 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-09872671-0d97-499d-badd-407f29eddcd0 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:46.450988 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-09872671-0d97-499d-badd-407f29eddcd0 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] [instance: 19245a9c-8e4c-406f-b0b8-1afbb5895c16] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:46.458528 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-09872671-0d97-499d-badd-407f29eddcd0 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:46.459620 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-09872671-0d97-499d-badd-407f29eddcd0 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:46.460489 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-09872671-0d97-499d-badd-407f29eddcd0 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:46.461317 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-09872671-0d97-499d-badd-407f29eddcd0 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:46.461904 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-09872671-0d97-499d-badd-407f29eddcd0 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:46.462441 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-09872671-0d97-499d-badd-407f29eddcd0 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:46.683378 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f68300c3-9858-4b4a-9822-5ead229fb5b3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:46.710160 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f68300c3-9858-4b4a-9822-5ead229fb5b3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:46.712751 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f68300c3-9858-4b4a-9822-5ead229fb5b3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:46.714220 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f68300c3-9858-4b4a-9822-5ead229fb5b3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1723 microversion: 2.20 time: 0.404302 Sep 06 22:44:46.728784 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 131/267] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:44:46 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1723 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:44:46.757927 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-09872671-0d97-499d-badd-407f29eddcd0 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e73bc19084a4bab9727b9dda49b37c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0aee19677643cbbaeff056c8e5a2c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:46.780674 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-09872671-0d97-499d-badd-407f29eddcd0 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] 10.222.0.39 "GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16" status: 200 len: 1314 microversion: 2.1 time: 0.354153 Sep 06 22:44:46.798460 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 137/268] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:46 2022] GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16 => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:47.450072 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-73bc6f76-5671-4fd5-b346-8403626cd106 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:47.450828 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-73bc6f76-5671-4fd5-b346-8403626cd106 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 5bcd7a9d-c2c8-489c-9827-b6be1508d63c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:47.472309 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-73bc6f76-5671-4fd5-b346-8403626cd106 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:47.473032 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-73bc6f76-5671-4fd5-b346-8403626cd106 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:47.473727 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-73bc6f76-5671-4fd5-b346-8403626cd106 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:47.474362 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-73bc6f76-5671-4fd5-b346-8403626cd106 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:47.474975 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-73bc6f76-5671-4fd5-b346-8403626cd106 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:47.475550 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-73bc6f76-5671-4fd5-b346-8403626cd106 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:47.660707 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-73bc6f76-5671-4fd5-b346-8403626cd106 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:47.671111 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-73bc6f76-5671-4fd5-b346-8403626cd106 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c" status: 200 len: 1522 microversion: 2.1 time: 0.224870 Sep 06 22:44:47.672244 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 132/269] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:47 2022] GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:47.739609 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-56ddb41f-fb20-41c6-825e-4b954c14b1fa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:47.740201 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-56ddb41f-fb20-41c6-825e-4b954c14b1fa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:47.742118 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:44:47.746864 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-56ddb41f-fb20-41c6-825e-4b954c14b1fa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:47.747348 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-56ddb41f-fb20-41c6-825e-4b954c14b1fa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:47.747764 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-56ddb41f-fb20-41c6-825e-4b954c14b1fa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:47.748685 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-56ddb41f-fb20-41c6-825e-4b954c14b1fa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:47.749307 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-56ddb41f-fb20-41c6-825e-4b954c14b1fa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:47.750343 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-56ddb41f-fb20-41c6-825e-4b954c14b1fa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:47.803868 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-517decb7-1913-4e54-a557-f8c71f55c426 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:47.804790 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-517decb7-1913-4e54-a557-f8c71f55c426 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] [instance: 19245a9c-8e4c-406f-b0b8-1afbb5895c16] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:47.810983 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-517decb7-1913-4e54-a557-f8c71f55c426 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:47.811463 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-517decb7-1913-4e54-a557-f8c71f55c426 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:47.811893 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-517decb7-1913-4e54-a557-f8c71f55c426 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:47.813187 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-517decb7-1913-4e54-a557-f8c71f55c426 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:47.813635 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-517decb7-1913-4e54-a557-f8c71f55c426 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:47.814380 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-517decb7-1913-4e54-a557-f8c71f55c426 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:48.010397 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-56ddb41f-fb20-41c6-825e-4b954c14b1fa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:48.021738 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-56ddb41f-fb20-41c6-825e-4b954c14b1fa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:48.023590 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-56ddb41f-fb20-41c6-825e-4b954c14b1fa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:48.024992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-56ddb41f-fb20-41c6-825e-4b954c14b1fa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1723 microversion: 2.20 time: 0.289256 Sep 06 22:44:48.025855 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 138/270] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:44:47 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1723 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 22:44:48.048381 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-517decb7-1913-4e54-a557-f8c71f55c426 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e73bc19084a4bab9727b9dda49b37c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0aee19677643cbbaeff056c8e5a2c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:48.056933 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-517decb7-1913-4e54-a557-f8c71f55c426 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] 10.222.0.39 "GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16" status: 200 len: 1314 microversion: 2.1 time: 0.256295 Sep 06 22:44:48.057330 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 133/271] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:47 2022] GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:44:48.697413 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-bea03583-d7f3-42ad-9572-e57633b61b79 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:48.698015 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-bea03583-d7f3-42ad-9572-e57633b61b79 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 5bcd7a9d-c2c8-489c-9827-b6be1508d63c] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:48.704849 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bea03583-d7f3-42ad-9572-e57633b61b79 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:48.705334 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bea03583-d7f3-42ad-9572-e57633b61b79 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:48.705757 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bea03583-d7f3-42ad-9572-e57633b61b79 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:48.706436 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bea03583-d7f3-42ad-9572-e57633b61b79 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:48.706877 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bea03583-d7f3-42ad-9572-e57633b61b79 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:48.707288 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bea03583-d7f3-42ad-9572-e57633b61b79 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:48.848298 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-bea03583-d7f3-42ad-9572-e57633b61b79 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:48.856422 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-bea03583-d7f3-42ad-9572-e57633b61b79 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c" status: 200 len: 1522 microversion: 2.1 time: 0.163378 Sep 06 22:44:48.857159 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 139/272] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:48 2022] GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:49.053172 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-399c4cfe-10a4-43bd-8046-fe376d95dbe3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:49.053998 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-399c4cfe-10a4-43bd-8046-fe376d95dbe3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:49.060891 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-399c4cfe-10a4-43bd-8046-fe376d95dbe3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:49.061413 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-399c4cfe-10a4-43bd-8046-fe376d95dbe3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:49.061873 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-399c4cfe-10a4-43bd-8046-fe376d95dbe3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:49.062781 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-399c4cfe-10a4-43bd-8046-fe376d95dbe3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:49.063246 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-399c4cfe-10a4-43bd-8046-fe376d95dbe3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:49.063804 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-399c4cfe-10a4-43bd-8046-fe376d95dbe3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:49.080379 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-bd7b5f30-5991-45c1-ba9a-782dd8c62070 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:49.081258 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-bd7b5f30-5991-45c1-ba9a-782dd8c62070 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] [instance: 19245a9c-8e4c-406f-b0b8-1afbb5895c16] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:49.087044 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd7b5f30-5991-45c1-ba9a-782dd8c62070 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:49.087525 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd7b5f30-5991-45c1-ba9a-782dd8c62070 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:49.087987 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd7b5f30-5991-45c1-ba9a-782dd8c62070 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:49.088660 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd7b5f30-5991-45c1-ba9a-782dd8c62070 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:49.089136 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd7b5f30-5991-45c1-ba9a-782dd8c62070 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:49.089548 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd7b5f30-5991-45c1-ba9a-782dd8c62070 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:49.278923 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-399c4cfe-10a4-43bd-8046-fe376d95dbe3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:49.287601 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-399c4cfe-10a4-43bd-8046-fe376d95dbe3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:49.289081 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-399c4cfe-10a4-43bd-8046-fe376d95dbe3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:49.290239 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-399c4cfe-10a4-43bd-8046-fe376d95dbe3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1723 microversion: 2.20 time: 0.241898 Sep 06 22:44:49.294907 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 134/273] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:44:49 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:44:49.295152 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-bd7b5f30-5991-45c1-ba9a-782dd8c62070 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e73bc19084a4bab9727b9dda49b37c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0aee19677643cbbaeff056c8e5a2c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:49.311128 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-bd7b5f30-5991-45c1-ba9a-782dd8c62070 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] 10.222.0.39 "GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16" status: 200 len: 1314 microversion: 2.1 time: 0.235476 Sep 06 22:44:49.311901 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 140/274] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:49 2022] GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:44:49.882869 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0a4e2e26-17c7-45d2-a163-082756c8b15e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:49.883780 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0a4e2e26-17c7-45d2-a163-082756c8b15e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 5bcd7a9d-c2c8-489c-9827-b6be1508d63c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:49.896368 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a4e2e26-17c7-45d2-a163-082756c8b15e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:49.897177 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a4e2e26-17c7-45d2-a163-082756c8b15e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:49.897830 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a4e2e26-17c7-45d2-a163-082756c8b15e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:49.898987 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a4e2e26-17c7-45d2-a163-082756c8b15e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:49.899605 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a4e2e26-17c7-45d2-a163-082756c8b15e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:49.900181 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a4e2e26-17c7-45d2-a163-082756c8b15e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:50.147901 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0a4e2e26-17c7-45d2-a163-082756c8b15e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:50.155662 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0a4e2e26-17c7-45d2-a163-082756c8b15e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c" status: 200 len: 1522 microversion: 2.1 time: 0.278713 Sep 06 22:44:50.156270 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 135/275] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:49 2022] GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:50.316211 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-1b3500ba-ee7f-4155-bcc7-3ce03981341f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:50.316840 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-1b3500ba-ee7f-4155-bcc7-3ce03981341f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:50.319037 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=2 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:44:50.319823 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=8 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:44:50.325977 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1b3500ba-ee7f-4155-bcc7-3ce03981341f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:50.326460 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1b3500ba-ee7f-4155-bcc7-3ce03981341f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:50.326887 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1b3500ba-ee7f-4155-bcc7-3ce03981341f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:50.327920 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1b3500ba-ee7f-4155-bcc7-3ce03981341f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:50.329300 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1b3500ba-ee7f-4155-bcc7-3ce03981341f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:50.331265 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1b3500ba-ee7f-4155-bcc7-3ce03981341f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:50.335840 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6aa87dbb-efbe-440b-9b6a-b0f975eba5ec tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:50.336739 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6aa87dbb-efbe-440b-9b6a-b0f975eba5ec tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] [instance: 19245a9c-8e4c-406f-b0b8-1afbb5895c16] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:50.339655 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=8 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:44:50.344223 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6aa87dbb-efbe-440b-9b6a-b0f975eba5ec tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:50.344939 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6aa87dbb-efbe-440b-9b6a-b0f975eba5ec tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:50.345504 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6aa87dbb-efbe-440b-9b6a-b0f975eba5ec tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:50.346616 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6aa87dbb-efbe-440b-9b6a-b0f975eba5ec tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:50.347155 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6aa87dbb-efbe-440b-9b6a-b0f975eba5ec tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:50.347601 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6aa87dbb-efbe-440b-9b6a-b0f975eba5ec tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:50.574360 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-1b3500ba-ee7f-4155-bcc7-3ce03981341f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:50.578053 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6aa87dbb-efbe-440b-9b6a-b0f975eba5ec tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e73bc19084a4bab9727b9dda49b37c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0aee19677643cbbaeff056c8e5a2c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:50.582777 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-1b3500ba-ee7f-4155-bcc7-3ce03981341f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:50.584221 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-1b3500ba-ee7f-4155-bcc7-3ce03981341f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:50.585387 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-1b3500ba-ee7f-4155-bcc7-3ce03981341f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1723 microversion: 2.20 time: 0.273865 Sep 06 22:44:50.585840 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6aa87dbb-efbe-440b-9b6a-b0f975eba5ec tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] 10.222.0.39 "GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16" status: 200 len: 1314 microversion: 2.1 time: 0.254230 Sep 06 22:44:50.585934 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 141/276] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:44:50 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1723 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:44:50.586406 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 136/277] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:50 2022] GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:44:50.950257 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-141d8d6e-de61-4d9b-8dd0-fab7a4d274c4 req-717bc0bf-20a8-4aa0-a3e9-581e95f24997 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19245a9c-8e4c-406f-b0b8-1afbb5895c16", "name": "network-vif-plugged", "status": "completed", "tag": "e65f96cc-fdef-4ae2-981c-67acf6f8f5ba"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:44:50.962524 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-141d8d6e-de61-4d9b-8dd0-fab7a4d274c4 req-717bc0bf-20a8-4aa0-a3e9-581e95f24997 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:50.963231 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-141d8d6e-de61-4d9b-8dd0-fab7a4d274c4 req-717bc0bf-20a8-4aa0-a3e9-581e95f24997 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:50.963919 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-141d8d6e-de61-4d9b-8dd0-fab7a4d274c4 req-717bc0bf-20a8-4aa0-a3e9-581e95f24997 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:50.980987 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-141d8d6e-de61-4d9b-8dd0-fab7a4d274c4 req-717bc0bf-20a8-4aa0-a3e9-581e95f24997 service nova] Creating event network-vif-plugged:e65f96cc-fdef-4ae2-981c-67acf6f8f5ba for instance 19245a9c-8e4c-406f-b0b8-1afbb5895c16 on hv-cinder-85220 Sep 06 22:44:51.006497 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-141d8d6e-de61-4d9b-8dd0-fab7a4d274c4 req-717bc0bf-20a8-4aa0-a3e9-581e95f24997 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060346 Sep 06 22:44:51.007246 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 142/278] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:44:51.179464 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b9a1c799-35f6-43a7-8ab6-0814300b9d16 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:51.180135 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b9a1c799-35f6-43a7-8ab6-0814300b9d16 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 5bcd7a9d-c2c8-489c-9827-b6be1508d63c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:51.187858 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b9a1c799-35f6-43a7-8ab6-0814300b9d16 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:51.188526 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b9a1c799-35f6-43a7-8ab6-0814300b9d16 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:51.189026 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b9a1c799-35f6-43a7-8ab6-0814300b9d16 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:51.189675 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b9a1c799-35f6-43a7-8ab6-0814300b9d16 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:51.190125 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b9a1c799-35f6-43a7-8ab6-0814300b9d16 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:51.190539 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b9a1c799-35f6-43a7-8ab6-0814300b9d16 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:51.357081 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b9a1c799-35f6-43a7-8ab6-0814300b9d16 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:51.364796 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b9a1c799-35f6-43a7-8ab6-0814300b9d16 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c" status: 200 len: 1522 microversion: 2.1 time: 0.189683 Sep 06 22:44:51.370548 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 137/279] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:51 2022] GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:51.609223 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f5a8170c-bfd1-4c3c-9a5f-f3b52cd89683 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:51.610824 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-f5a8170c-bfd1-4c3c-9a5f-f3b52cd89683 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] [instance: 19245a9c-8e4c-406f-b0b8-1afbb5895c16] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:51.611581 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0011fd4d-5049-44b5-af81-9b62b60abcce tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:51.612501 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0011fd4d-5049-44b5-af81-9b62b60abcce tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:51.617304 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f5a8170c-bfd1-4c3c-9a5f-f3b52cd89683 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:51.617869 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f5a8170c-bfd1-4c3c-9a5f-f3b52cd89683 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:51.618266 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f5a8170c-bfd1-4c3c-9a5f-f3b52cd89683 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:51.618941 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f5a8170c-bfd1-4c3c-9a5f-f3b52cd89683 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:51.619382 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f5a8170c-bfd1-4c3c-9a5f-f3b52cd89683 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:51.619501 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0011fd4d-5049-44b5-af81-9b62b60abcce tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:51.619790 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f5a8170c-bfd1-4c3c-9a5f-f3b52cd89683 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:51.619927 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0011fd4d-5049-44b5-af81-9b62b60abcce tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:51.620307 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0011fd4d-5049-44b5-af81-9b62b60abcce tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:51.621015 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0011fd4d-5049-44b5-af81-9b62b60abcce tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:51.621778 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0011fd4d-5049-44b5-af81-9b62b60abcce tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:51.622531 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0011fd4d-5049-44b5-af81-9b62b60abcce tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:51.627687 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:44:51.845160 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-f5a8170c-bfd1-4c3c-9a5f-f3b52cd89683 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e73bc19084a4bab9727b9dda49b37c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0aee19677643cbbaeff056c8e5a2c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:51.850628 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0011fd4d-5049-44b5-af81-9b62b60abcce tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:51.853885 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-f5a8170c-bfd1-4c3c-9a5f-f3b52cd89683 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] 10.222.0.39 "GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16" status: 200 len: 1314 microversion: 2.1 time: 0.248906 Sep 06 22:44:51.855447 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 143/280] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:51 2022] GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:51.859618 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0011fd4d-5049-44b5-af81-9b62b60abcce tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:51.861817 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0011fd4d-5049-44b5-af81-9b62b60abcce tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:51.863059 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0011fd4d-5049-44b5-af81-9b62b60abcce tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1723 microversion: 2.20 time: 0.255793 Sep 06 22:44:51.872843 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 138/281] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:44:51 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 22:44:52.387522 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a013a11b-0976-48aa-bf50-b456e5cc5343 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:52.388368 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-a013a11b-0976-48aa-bf50-b456e5cc5343 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 5bcd7a9d-c2c8-489c-9827-b6be1508d63c] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:52.397976 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a013a11b-0976-48aa-bf50-b456e5cc5343 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:52.398450 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a013a11b-0976-48aa-bf50-b456e5cc5343 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:52.398869 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a013a11b-0976-48aa-bf50-b456e5cc5343 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:52.399553 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a013a11b-0976-48aa-bf50-b456e5cc5343 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:52.399992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a013a11b-0976-48aa-bf50-b456e5cc5343 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:52.400408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a013a11b-0976-48aa-bf50-b456e5cc5343 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:52.587659 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-a013a11b-0976-48aa-bf50-b456e5cc5343 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:52.596130 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-a013a11b-0976-48aa-bf50-b456e5cc5343 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c" status: 200 len: 1522 microversion: 2.1 time: 0.212436 Sep 06 22:44:52.597146 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 144/282] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:52 2022] GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:52.877554 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8d2a019b-8f3f-48c3-a0b9-cf4d710054a4 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:52.878165 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8d2a019b-8f3f-48c3-a0b9-cf4d710054a4 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] [instance: 19245a9c-8e4c-406f-b0b8-1afbb5895c16] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:52.885943 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d2a019b-8f3f-48c3-a0b9-cf4d710054a4 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:52.886429 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d2a019b-8f3f-48c3-a0b9-cf4d710054a4 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:52.886859 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d2a019b-8f3f-48c3-a0b9-cf4d710054a4 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:52.887232 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9dc81e9c-b14e-4f8a-b133-094477e5237e tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:52.887669 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d2a019b-8f3f-48c3-a0b9-cf4d710054a4 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:52.888114 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d2a019b-8f3f-48c3-a0b9-cf4d710054a4 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:52.888567 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d2a019b-8f3f-48c3-a0b9-cf4d710054a4 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:52.888861 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9dc81e9c-b14e-4f8a-b133-094477e5237e tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:52.897798 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9dc81e9c-b14e-4f8a-b133-094477e5237e tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:52.897798 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9dc81e9c-b14e-4f8a-b133-094477e5237e tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:52.897798 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9dc81e9c-b14e-4f8a-b133-094477e5237e tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:52.898140 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9dc81e9c-b14e-4f8a-b133-094477e5237e tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:52.898823 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9dc81e9c-b14e-4f8a-b133-094477e5237e tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:52.899111 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9dc81e9c-b14e-4f8a-b133-094477e5237e tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:53.113234 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8d2a019b-8f3f-48c3-a0b9-cf4d710054a4 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e73bc19084a4bab9727b9dda49b37c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0aee19677643cbbaeff056c8e5a2c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:53.122166 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9dc81e9c-b14e-4f8a-b133-094477e5237e tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:53.132635 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8d2a019b-8f3f-48c3-a0b9-cf4d710054a4 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] 10.222.0.39 "GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16" status: 200 len: 1314 microversion: 2.1 time: 0.259512 Sep 06 22:44:53.133261 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 139/283] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:52 2022] GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:53.140027 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9dc81e9c-b14e-4f8a-b133-094477e5237e tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:53.141910 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9dc81e9c-b14e-4f8a-b133-094477e5237e tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:53.143206 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9dc81e9c-b14e-4f8a-b133-094477e5237e tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1723 microversion: 2.20 time: 0.259556 Sep 06 22:44:53.144553 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 145/284] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:44:52 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 22:44:53.620634 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8c186566-20d3-4c1f-8e52-ebce2140e85b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:53.621846 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8c186566-20d3-4c1f-8e52-ebce2140e85b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 5bcd7a9d-c2c8-489c-9827-b6be1508d63c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:53.628908 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8c186566-20d3-4c1f-8e52-ebce2140e85b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:53.629492 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8c186566-20d3-4c1f-8e52-ebce2140e85b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:53.629925 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8c186566-20d3-4c1f-8e52-ebce2140e85b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:53.630820 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8c186566-20d3-4c1f-8e52-ebce2140e85b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:53.631755 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8c186566-20d3-4c1f-8e52-ebce2140e85b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:53.632184 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8c186566-20d3-4c1f-8e52-ebce2140e85b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:53.784129 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8c186566-20d3-4c1f-8e52-ebce2140e85b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:53.793392 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8c186566-20d3-4c1f-8e52-ebce2140e85b tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c" status: 200 len: 1522 microversion: 2.1 time: 0.176503 Sep 06 22:44:53.794081 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 140/285] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:53 2022] GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:54.167455 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-08566663-9718-4220-ba83-1d947ab47ec1 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:54.168804 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-08566663-9718-4220-ba83-1d947ab47ec1 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] [instance: 19245a9c-8e4c-406f-b0b8-1afbb5895c16] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:54.174764 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-08566663-9718-4220-ba83-1d947ab47ec1 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:54.175508 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-08566663-9718-4220-ba83-1d947ab47ec1 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:54.175643 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9aba75c6-e418-42e0-8882-9425bb10a232 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:54.176294 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9aba75c6-e418-42e0-8882-9425bb10a232 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:54.176748 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-08566663-9718-4220-ba83-1d947ab47ec1 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:54.177627 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-08566663-9718-4220-ba83-1d947ab47ec1 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:54.178327 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-08566663-9718-4220-ba83-1d947ab47ec1 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:54.178897 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-08566663-9718-4220-ba83-1d947ab47ec1 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:54.195918 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9aba75c6-e418-42e0-8882-9425bb10a232 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:54.196426 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9aba75c6-e418-42e0-8882-9425bb10a232 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:54.196912 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9aba75c6-e418-42e0-8882-9425bb10a232 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:54.197604 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9aba75c6-e418-42e0-8882-9425bb10a232 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:54.198061 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9aba75c6-e418-42e0-8882-9425bb10a232 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:54.198487 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9aba75c6-e418-42e0-8882-9425bb10a232 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:54.647342 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-08566663-9718-4220-ba83-1d947ab47ec1 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e73bc19084a4bab9727b9dda49b37c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0aee19677643cbbaeff056c8e5a2c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:54.656718 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-08566663-9718-4220-ba83-1d947ab47ec1 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] 10.222.0.39 "GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16" status: 200 len: 1314 microversion: 2.1 time: 0.492258 Sep 06 22:44:54.657432 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 146/286] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:54 2022] GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16 => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:54.661624 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9aba75c6-e418-42e0-8882-9425bb10a232 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:54.669864 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9aba75c6-e418-42e0-8882-9425bb10a232 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:54.672331 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9aba75c6-e418-42e0-8882-9425bb10a232 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:54.673776 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9aba75c6-e418-42e0-8882-9425bb10a232 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1723 microversion: 2.20 time: 0.502977 Sep 06 22:44:54.674334 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 141/287] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:44:54 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1723 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 22:44:54.816054 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-fa072748-4106-495c-9006-21385a87c0e6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:54.816660 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-fa072748-4106-495c-9006-21385a87c0e6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 5bcd7a9d-c2c8-489c-9827-b6be1508d63c] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:54.825957 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fa072748-4106-495c-9006-21385a87c0e6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:54.826474 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fa072748-4106-495c-9006-21385a87c0e6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:54.826897 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fa072748-4106-495c-9006-21385a87c0e6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:54.827603 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fa072748-4106-495c-9006-21385a87c0e6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:54.828610 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fa072748-4106-495c-9006-21385a87c0e6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:54.829182 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fa072748-4106-495c-9006-21385a87c0e6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:54.833570 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=100 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:44:55.006234 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-fa072748-4106-495c-9006-21385a87c0e6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:55.014582 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-fa072748-4106-495c-9006-21385a87c0e6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c" status: 200 len: 1522 microversion: 2.1 time: 0.202868 Sep 06 22:44:55.015147 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 147/288] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:54 2022] GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:55.070297 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d36c9e84-fc9b-4818-8ad7-81b1dda484f8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:44:55.076826 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d36c9e84-fc9b-4818-8ad7-81b1dda484f8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:55.077395 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d36c9e84-fc9b-4818-8ad7-81b1dda484f8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:55.078627 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d36c9e84-fc9b-4818-8ad7-81b1dda484f8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:55.144123 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d36c9e84-fc9b-4818-8ad7-81b1dda484f8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Going to try to stop instance {{(pid=127088) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 06 22:44:55.190689 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d36c9e84-fc9b-4818-8ad7-81b1dda484f8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "POST /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5/action" status: 202 len: 0 microversion: 2.1 time: 0.124756 Sep 06 22:44:55.191379 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 142/289] 10.222.0.39 () {60 vars in 1278 bytes} [Tue Sep 6 22:44:55 2022] POST /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 22:44:55.199392 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d90602d8-624c-4348-b120-0c1a67ac51c8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:55.200811 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-d90602d8-624c-4348-b120-0c1a67ac51c8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:55.208367 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d90602d8-624c-4348-b120-0c1a67ac51c8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:55.209205 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d90602d8-624c-4348-b120-0c1a67ac51c8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:55.209880 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d90602d8-624c-4348-b120-0c1a67ac51c8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:55.210860 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d90602d8-624c-4348-b120-0c1a67ac51c8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:55.211373 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d90602d8-624c-4348-b120-0c1a67ac51c8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:55.211797 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d90602d8-624c-4348-b120-0c1a67ac51c8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:55.350579 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-d90602d8-624c-4348-b120-0c1a67ac51c8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:55.358866 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d90602d8-624c-4348-b120-0c1a67ac51c8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1724 microversion: 2.1 time: 0.163453 Sep 06 22:44:55.360830 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 148/290] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:55 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:55.681758 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ff36896f-6de4-47f5-9f63-7538832dfc64 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:55.682483 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ff36896f-6de4-47f5-9f63-7538832dfc64 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] [instance: 19245a9c-8e4c-406f-b0b8-1afbb5895c16] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:55.688655 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ff36896f-6de4-47f5-9f63-7538832dfc64 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:55.689168 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ff36896f-6de4-47f5-9f63-7538832dfc64 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:55.689599 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ff36896f-6de4-47f5-9f63-7538832dfc64 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:55.690281 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ff36896f-6de4-47f5-9f63-7538832dfc64 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:55.690766 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ff36896f-6de4-47f5-9f63-7538832dfc64 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:55.691143 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ff36896f-6de4-47f5-9f63-7538832dfc64 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:55.701975 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-2155e5a2-14ed-44e1-9e7c-87ce27411a14 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:55.701975 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-2155e5a2-14ed-44e1-9e7c-87ce27411a14 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:55.708849 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2155e5a2-14ed-44e1-9e7c-87ce27411a14 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:55.709328 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2155e5a2-14ed-44e1-9e7c-87ce27411a14 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:55.709761 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2155e5a2-14ed-44e1-9e7c-87ce27411a14 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:55.710563 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2155e5a2-14ed-44e1-9e7c-87ce27411a14 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:55.711589 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2155e5a2-14ed-44e1-9e7c-87ce27411a14 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:55.712000 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2155e5a2-14ed-44e1-9e7c-87ce27411a14 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:55.885954 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ff36896f-6de4-47f5-9f63-7538832dfc64 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e73bc19084a4bab9727b9dda49b37c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0aee19677643cbbaeff056c8e5a2c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:55.894392 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ff36896f-6de4-47f5-9f63-7538832dfc64 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] 10.222.0.39 "GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16" status: 200 len: 1463 microversion: 2.1 time: 0.216858 Sep 06 22:44:55.894964 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 143/291] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:55 2022] GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16 => generated 1463 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:55.897447 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-2155e5a2-14ed-44e1-9e7c-87ce27411a14 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:55.905483 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-2155e5a2-14ed-44e1-9e7c-87ce27411a14 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:55.907032 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-2155e5a2-14ed-44e1-9e7c-87ce27411a14 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:55.908164 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-2155e5a2-14ed-44e1-9e7c-87ce27411a14 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1723 microversion: 2.20 time: 0.211751 Sep 06 22:44:55.908705 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 149/292] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:44:55 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:44:55.941054 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ac4df2dd-84c7-4908-b812-67c76420296e tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:55.941549 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ac4df2dd-84c7-4908-b812-67c76420296e tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] [instance: 19245a9c-8e4c-406f-b0b8-1afbb5895c16] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:55.947414 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac4df2dd-84c7-4908-b812-67c76420296e tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:55.947901 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac4df2dd-84c7-4908-b812-67c76420296e tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:55.948333 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac4df2dd-84c7-4908-b812-67c76420296e tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:55.949130 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac4df2dd-84c7-4908-b812-67c76420296e tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:55.949577 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac4df2dd-84c7-4908-b812-67c76420296e tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:55.949997 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac4df2dd-84c7-4908-b812-67c76420296e tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:55.977416 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ac4df2dd-84c7-4908-b812-67c76420296e tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] [instance: 19245a9c-8e4c-406f-b0b8-1afbb5895c16] Going to try to terminate instance {{(pid=127088) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 22:44:56.043042 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6a8d0082-b3b3-47f4-8817-53cf4901cd0a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:56.043631 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-6a8d0082-b3b3-47f4-8817-53cf4901cd0a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 5bcd7a9d-c2c8-489c-9827-b6be1508d63c] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:56.050491 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6a8d0082-b3b3-47f4-8817-53cf4901cd0a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:56.051134 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6a8d0082-b3b3-47f4-8817-53cf4901cd0a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:56.051638 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6a8d0082-b3b3-47f4-8817-53cf4901cd0a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:56.052320 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6a8d0082-b3b3-47f4-8817-53cf4901cd0a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:56.052895 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6a8d0082-b3b3-47f4-8817-53cf4901cd0a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:56.053309 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6a8d0082-b3b3-47f4-8817-53cf4901cd0a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:56.053743 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ac4df2dd-84c7-4908-b812-67c76420296e tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] 10.222.0.39 "DELETE /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16" status: 204 len: 0 microversion: 2.1 time: 0.116847 Sep 06 22:44:56.054607 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 144/293] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Sep 6 22:44:55 2022] DELETE /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 22:44:56.063075 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-698550c4-5fce-48f5-b829-f068c2615cd1 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:56.063765 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-698550c4-5fce-48f5-b829-f068c2615cd1 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] [instance: 19245a9c-8e4c-406f-b0b8-1afbb5895c16] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:56.069575 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-698550c4-5fce-48f5-b829-f068c2615cd1 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:56.070051 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-698550c4-5fce-48f5-b829-f068c2615cd1 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:56.070479 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-698550c4-5fce-48f5-b829-f068c2615cd1 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:56.071164 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-698550c4-5fce-48f5-b829-f068c2615cd1 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:56.071612 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-698550c4-5fce-48f5-b829-f068c2615cd1 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:56.072033 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-698550c4-5fce-48f5-b829-f068c2615cd1 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:56.257626 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6a8d0082-b3b3-47f4-8817-53cf4901cd0a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:56.261809 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-698550c4-5fce-48f5-b829-f068c2615cd1 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e73bc19084a4bab9727b9dda49b37c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0aee19677643cbbaeff056c8e5a2c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:56.265941 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-6a8d0082-b3b3-47f4-8817-53cf4901cd0a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c" status: 200 len: 1522 microversion: 2.1 time: 0.226657 Sep 06 22:44:56.266974 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 150/294] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:56 2022] GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:44:56.271409 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-698550c4-5fce-48f5-b829-f068c2615cd1 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] 10.222.0.39 "GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16" status: 200 len: 1469 microversion: 2.1 time: 0.212435 Sep 06 22:44:56.272170 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 145/295] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:56 2022] GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16 => generated 1469 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:44:56.382706 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-4971c949-ecd7-4495-956c-b6fb7b689463 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:56.383358 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-4971c949-ecd7-4495-956c-b6fb7b689463 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:56.389327 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4971c949-ecd7-4495-956c-b6fb7b689463 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:56.389808 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4971c949-ecd7-4495-956c-b6fb7b689463 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:56.390724 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4971c949-ecd7-4495-956c-b6fb7b689463 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:56.391404 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4971c949-ecd7-4495-956c-b6fb7b689463 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:56.391849 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4971c949-ecd7-4495-956c-b6fb7b689463 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:56.392264 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4971c949-ecd7-4495-956c-b6fb7b689463 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:56.580933 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-4971c949-ecd7-4495-956c-b6fb7b689463 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:56.588799 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-4971c949-ecd7-4495-956c-b6fb7b689463 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1724 microversion: 2.1 time: 0.209832 Sep 06 22:44:56.589355 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 151/296] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:56 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:56.934649 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2a2f630d-d4ec-4870-a27b-9dc8c53fec11 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:56.935340 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2a2f630d-d4ec-4870-a27b-9dc8c53fec11 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:56.942511 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2a2f630d-d4ec-4870-a27b-9dc8c53fec11 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:56.942991 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2a2f630d-d4ec-4870-a27b-9dc8c53fec11 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:56.943415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2a2f630d-d4ec-4870-a27b-9dc8c53fec11 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:56.944105 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2a2f630d-d4ec-4870-a27b-9dc8c53fec11 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:56.944551 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2a2f630d-d4ec-4870-a27b-9dc8c53fec11 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:56.945000 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2a2f630d-d4ec-4870-a27b-9dc8c53fec11 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:57.076062 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2a2f630d-d4ec-4870-a27b-9dc8c53fec11 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:57.084572 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2a2f630d-d4ec-4870-a27b-9dc8c53fec11 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:57.086045 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2a2f630d-d4ec-4870-a27b-9dc8c53fec11 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:57.087186 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2a2f630d-d4ec-4870-a27b-9dc8c53fec11 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1723 microversion: 2.20 time: 0.156583 Sep 06 22:44:57.087738 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 146/297] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:44:56 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:44:57.289414 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-64efcbb4-4e6b-4002-bb25-e5fda5cdd109 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:57.290065 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-64efcbb4-4e6b-4002-bb25-e5fda5cdd109 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 5bcd7a9d-c2c8-489c-9827-b6be1508d63c] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:57.294294 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-43405fac-1946-4a54-9c44-487adf5cd635 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:57.294898 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-43405fac-1946-4a54-9c44-487adf5cd635 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] [instance: 19245a9c-8e4c-406f-b0b8-1afbb5895c16] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:57.296016 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-64efcbb4-4e6b-4002-bb25-e5fda5cdd109 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:57.297020 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-64efcbb4-4e6b-4002-bb25-e5fda5cdd109 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:57.297445 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-64efcbb4-4e6b-4002-bb25-e5fda5cdd109 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:57.298138 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-64efcbb4-4e6b-4002-bb25-e5fda5cdd109 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:57.298584 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-64efcbb4-4e6b-4002-bb25-e5fda5cdd109 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:57.299000 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-64efcbb4-4e6b-4002-bb25-e5fda5cdd109 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:57.302303 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-43405fac-1946-4a54-9c44-487adf5cd635 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:57.302785 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-43405fac-1946-4a54-9c44-487adf5cd635 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:57.303214 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-43405fac-1946-4a54-9c44-487adf5cd635 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:57.303957 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-43405fac-1946-4a54-9c44-487adf5cd635 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:57.304409 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-43405fac-1946-4a54-9c44-487adf5cd635 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:57.304859 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-43405fac-1946-4a54-9c44-487adf5cd635 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:57.489152 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-64efcbb4-4e6b-4002-bb25-e5fda5cdd109 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:57.496039 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-43405fac-1946-4a54-9c44-487adf5cd635 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e73bc19084a4bab9727b9dda49b37c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0aee19677643cbbaeff056c8e5a2c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:57.497255 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-64efcbb4-4e6b-4002-bb25-e5fda5cdd109 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c" status: 200 len: 1502 microversion: 2.1 time: 0.211753 Sep 06 22:44:57.497928 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 152/298] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:57 2022] GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c => generated 1502 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:57.505519 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-43405fac-1946-4a54-9c44-487adf5cd635 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] 10.222.0.39 "GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16" status: 200 len: 1469 microversion: 2.1 time: 0.214944 Sep 06 22:44:57.506078 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 147/299] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:57 2022] GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16 => generated 1469 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:44:57.524959 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-cde44d19-fcae-4dfb-836a-743647480677 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5aee227e-abbf-467d-9f5e-5d7eeda8715d"}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:44:57.524959 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-cde44d19-fcae-4dfb-836a-743647480677 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 5bcd7a9d-c2c8-489c-9827-b6be1508d63c] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:57.530459 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cde44d19-fcae-4dfb-836a-743647480677 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:57.530960 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cde44d19-fcae-4dfb-836a-743647480677 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:57.531589 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cde44d19-fcae-4dfb-836a-743647480677 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:57.532267 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cde44d19-fcae-4dfb-836a-743647480677 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:57.532708 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cde44d19-fcae-4dfb-836a-743647480677 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:57.533154 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cde44d19-fcae-4dfb-836a-743647480677 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:57.555338 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-cde44d19-fcae-4dfb-836a-743647480677 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] HTTP exception thrown: Cannot 'attach_volume' instance 5bcd7a9d-c2c8-489c-9827-b6be1508d63c while it is in vm_state rescued Sep 06 22:44:57.557155 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-cde44d19-fcae-4dfb-836a-743647480677 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Request method failure captured: Sep 06 22:44:57.557155 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: request: POST /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c/os-volume_attachments HTTP/1.1 Sep 06 22:44:57.557155 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept: application/json Sep 06 22:44:57.557155 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Sep 06 22:44:57.557155 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Connection: close Sep 06 22:44:57.557155 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Length: 74 Sep 06 22:44:57.557155 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Type: application/json Sep 06 22:44:57.557155 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Host: 10.222.0.39 Sep 06 22:44:57.557155 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Sep 06 22:44:57.557155 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.12 Sep 06 22:44:57.557155 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABjF8zr3ZzLjA2gwI7YEUt9cbBvmbp_x4ePSTIy-YRHBGO1km1XYQsyRXo1bKQtaluJ7IZzwPTYhu0Q2-OK1qDco29jAZu8GJ0xy8vIJ8lATrAGg8YhLEoTAMLN9QKkngqWKdXs7keDyDgD2zskPjbWbA9c5uX7NbZdbQA8YqfAuMZMfA0 Sep 06 22:44:57.557155 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Sep 06 22:44:57.557155 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Sep 06 22:44:57.557155 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Sep 06 22:44:57.557155 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Sep 06 22:44:57.557155 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Sep 06 22:44:57.557155 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Sep 06 22:44:57.557155 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Id: 84c39ea86193481fa08158197629ea85 Sep 06 22:44:57.557155 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1404608848 Sep 06 22:44:57.557155 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Role: reader,member Sep 06 22:44:57.557155 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Sep 06 22:44:57.558737 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/84c39ea86193481fa08158197629ea85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_84c39ea86193481fa08158197629ea85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/84c39ea86193481fa08158197629ea85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/84c39ea86193481fa08158197629ea85"}]}] Sep 06 22:44:57.558737 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1404608848 Sep 06 22:44:57.558737 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 84c39ea86193481fa08158197629ea85 Sep 06 22:44:57.558737 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1404608848 Sep 06 22:44:57.558737 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User: tempest-ServerRescueNegativeTestJSON-1404608848-project Sep 06 22:44:57.558737 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Sep 06 22:44:57.558737 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Sep 06 22:44:57.558737 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Id: 2945d87f1c114dd0b42c4e58a8133e76 Sep 06 22:44:57.558737 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1404608848-project Sep 06 22:44:57.558737 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Sep 06 22:44:57.558737 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: {"volumeAttachment": {"volumeId": "5aee227e-abbf-467d-9f5e-5d7eeda8715d"}} Sep 06 22:44:57.558737 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: method: > Sep 06 22:44:57.563816 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: exception: Cannot 'attach_volume' instance 5bcd7a9d-c2c8-489c-9827-b6be1508d63c while it is in vm_state rescued Sep 06 22:44:57.563816 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: action_args: {'server_id': '5bcd7a9d-c2c8-489c-9827-b6be1508d63c', 'body': {'volumeAttachment': {'volumeId': '5aee227e-abbf-467d-9f5e-5d7eeda8715d'}}} Sep 06 22:44:57.563816 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:44:57.563816 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:44:57.563816 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 06 22:44:57.563816 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 06 22:44:57.563816 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 22:44:57.563816 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 22:44:57.563816 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 06 22:44:57.563816 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 06 22:44:57.563816 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5bcd7a9d-c2c8-489c-9827-b6be1508d63c in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 06 22:44:57.563816 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:44:57.563816 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:44:57.563816 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:44:57.563816 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:44:57.563816 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:44:57.563816 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:44:57.563816 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:44:57.563816 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:44:57.565245 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:44:57.565245 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:44:57.565245 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 22:44:57.565245 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 22:44:57.565245 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 22:44:57.565245 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 22:44:57.565245 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 22:44:57.565245 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 22:44:57.565245 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 06 22:44:57.565245 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 06 22:44:57.565245 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 06 22:44:57.565245 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 06 22:44:57.565245 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 5bcd7a9d-c2c8-489c-9827-b6be1508d63c while it is in vm_state rescued Sep 06 22:44:57.565245 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:44:57.565245 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:44:57.565245 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:44:57.565245 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:44:57.565245 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:44:57.565245 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:44:57.566563 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:44:57.566563 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:44:57.566563 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 5bcd7a9d-c2c8-489c-9827-b6be1508d63c while it is in vm_state rescued Sep 06 22:44:57.566563 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:44:57.566563 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-cde44d19-fcae-4dfb-836a-743647480677 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Returning 409 to user: Cannot 'attach_volume' instance 5bcd7a9d-c2c8-489c-9827-b6be1508d63c while it is in vm_state rescued {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:44:57.566563 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-cde44d19-fcae-4dfb-836a-743647480677 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "POST /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040617 Sep 06 22:44:57.566563 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 153/300] 10.222.0.39 () {60 vars in 1323 bytes} [Tue Sep 6 22:44:57 2022] POST /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 06 22:44:57.570954 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-88052e0d-b5b5-4038-94e2-7413a2bba4db tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:44:57.571485 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-88052e0d-b5b5-4038-94e2-7413a2bba4db tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 5bcd7a9d-c2c8-489c-9827-b6be1508d63c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:57.577377 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88052e0d-b5b5-4038-94e2-7413a2bba4db tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:57.577930 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88052e0d-b5b5-4038-94e2-7413a2bba4db tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:57.578365 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88052e0d-b5b5-4038-94e2-7413a2bba4db tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:57.579154 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88052e0d-b5b5-4038-94e2-7413a2bba4db tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:57.579640 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88052e0d-b5b5-4038-94e2-7413a2bba4db tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:57.580055 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88052e0d-b5b5-4038-94e2-7413a2bba4db tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:57.614778 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-02cb0fe6-f916-4e3b-82c0-ef2fde1eb955 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:57.615500 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-02cb0fe6-f916-4e3b-82c0-ef2fde1eb955 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:57.622361 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-02cb0fe6-f916-4e3b-82c0-ef2fde1eb955 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:57.622925 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-02cb0fe6-f916-4e3b-82c0-ef2fde1eb955 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:57.623572 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-02cb0fe6-f916-4e3b-82c0-ef2fde1eb955 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:57.624229 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-02cb0fe6-f916-4e3b-82c0-ef2fde1eb955 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:57.625008 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-02cb0fe6-f916-4e3b-82c0-ef2fde1eb955 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:57.625753 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-02cb0fe6-f916-4e3b-82c0-ef2fde1eb955 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:57.658455 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-88052e0d-b5b5-4038-94e2-7413a2bba4db tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "POST /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c/action" status: 202 len: 0 microversion: 2.1 time: 0.093222 Sep 06 22:44:57.659235 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 148/301] 10.222.0.39 () {60 vars in 1278 bytes} [Tue Sep 6 22:44:57 2022] POST /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 22:44:57.668932 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5282bf6e-f69d-41e1-94e7-b71af0466f0e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:57.669752 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5282bf6e-f69d-41e1-94e7-b71af0466f0e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 5bcd7a9d-c2c8-489c-9827-b6be1508d63c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:57.676751 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5282bf6e-f69d-41e1-94e7-b71af0466f0e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:57.677275 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5282bf6e-f69d-41e1-94e7-b71af0466f0e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:57.677706 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5282bf6e-f69d-41e1-94e7-b71af0466f0e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:57.678406 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5282bf6e-f69d-41e1-94e7-b71af0466f0e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:57.678860 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5282bf6e-f69d-41e1-94e7-b71af0466f0e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:57.679282 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5282bf6e-f69d-41e1-94e7-b71af0466f0e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:57.846694 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-02cb0fe6-f916-4e3b-82c0-ef2fde1eb955 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:57.855367 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-02cb0fe6-f916-4e3b-82c0-ef2fde1eb955 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1724 microversion: 2.1 time: 0.244602 Sep 06 22:44:57.855938 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 154/302] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:57 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:57.872042 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5282bf6e-f69d-41e1-94e7-b71af0466f0e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:57.880876 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5282bf6e-f69d-41e1-94e7-b71af0466f0e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c" status: 200 len: 1510 microversion: 2.1 time: 0.215891 Sep 06 22:44:57.881449 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 149/303] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:57 2022] GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c => generated 1510 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:44:58.114255 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e3fcbea7-0433-4eca-ace0-32be3b41d4bf tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:58.114868 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e3fcbea7-0433-4eca-ace0-32be3b41d4bf tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:58.120889 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e3fcbea7-0433-4eca-ace0-32be3b41d4bf tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:58.121370 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e3fcbea7-0433-4eca-ace0-32be3b41d4bf tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:58.121794 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e3fcbea7-0433-4eca-ace0-32be3b41d4bf tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:58.122494 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e3fcbea7-0433-4eca-ace0-32be3b41d4bf tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:58.122920 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e3fcbea7-0433-4eca-ace0-32be3b41d4bf tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:58.123336 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e3fcbea7-0433-4eca-ace0-32be3b41d4bf tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:58.327605 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e3fcbea7-0433-4eca-ace0-32be3b41d4bf tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:58.338934 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e3fcbea7-0433-4eca-ace0-32be3b41d4bf tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:58.341358 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e3fcbea7-0433-4eca-ace0-32be3b41d4bf tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:58.342891 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e3fcbea7-0433-4eca-ace0-32be3b41d4bf tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1723 microversion: 2.20 time: 0.232520 Sep 06 22:44:58.345197 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 155/304] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:44:58 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:44:58.532191 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6c3012ff-8903-4a1d-9c79-97a38e6c054c tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:58.532191 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6c3012ff-8903-4a1d-9c79-97a38e6c054c tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] [instance: 19245a9c-8e4c-406f-b0b8-1afbb5895c16] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:58.539097 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c3012ff-8903-4a1d-9c79-97a38e6c054c tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:58.539790 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c3012ff-8903-4a1d-9c79-97a38e6c054c tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:58.540378 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c3012ff-8903-4a1d-9c79-97a38e6c054c tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:58.541259 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c3012ff-8903-4a1d-9c79-97a38e6c054c tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:58.541922 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c3012ff-8903-4a1d-9c79-97a38e6c054c tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:58.542422 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c3012ff-8903-4a1d-9c79-97a38e6c054c tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:58.851528 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6c3012ff-8903-4a1d-9c79-97a38e6c054c tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e73bc19084a4bab9727b9dda49b37c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0aee19677643cbbaeff056c8e5a2c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:58.859800 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6c3012ff-8903-4a1d-9c79-97a38e6c054c tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] 10.222.0.39 "GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16" status: 200 len: 1469 microversion: 2.1 time: 0.332553 Sep 06 22:44:58.860804 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 150/305] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:58 2022] GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16 => generated 1469 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:58.879544 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-47f5a36c-fb5a-4ce6-bed4-93aee7d72710 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:58.880303 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-47f5a36c-fb5a-4ce6-bed4-93aee7d72710 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:58.886710 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-47f5a36c-fb5a-4ce6-bed4-93aee7d72710 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:58.887228 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-47f5a36c-fb5a-4ce6-bed4-93aee7d72710 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:58.888480 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-47f5a36c-fb5a-4ce6-bed4-93aee7d72710 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:58.889610 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-47f5a36c-fb5a-4ce6-bed4-93aee7d72710 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:58.890090 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-47f5a36c-fb5a-4ce6-bed4-93aee7d72710 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:58.892168 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-47f5a36c-fb5a-4ce6-bed4-93aee7d72710 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:58.904141 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-943a667d-0d84-4152-a059-bc33a4cc423f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:58.905085 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-943a667d-0d84-4152-a059-bc33a4cc423f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 5bcd7a9d-c2c8-489c-9827-b6be1508d63c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:58.923518 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-943a667d-0d84-4152-a059-bc33a4cc423f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:58.924017 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-943a667d-0d84-4152-a059-bc33a4cc423f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:58.924450 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-943a667d-0d84-4152-a059-bc33a4cc423f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:58.925186 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-943a667d-0d84-4152-a059-bc33a4cc423f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:58.925641 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-943a667d-0d84-4152-a059-bc33a4cc423f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:58.926066 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-943a667d-0d84-4152-a059-bc33a4cc423f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:58.930760 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:44:59.209122 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-47f5a36c-fb5a-4ce6-bed4-93aee7d72710 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:59.219011 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-47f5a36c-fb5a-4ce6-bed4-93aee7d72710 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1724 microversion: 2.1 time: 0.342912 Sep 06 22:44:59.219839 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-943a667d-0d84-4152-a059-bc33a4cc423f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:59.219995 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 156/306] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:58 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1724 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:59.230212 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-943a667d-0d84-4152-a059-bc33a4cc423f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c" status: 200 len: 1510 microversion: 2.1 time: 0.330378 Sep 06 22:44:59.242003 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 151/307] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:58 2022] GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c => generated 1510 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:44:59.316300 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-21172364-ba7c-4bed-9a9c-72ad9f1c54eb req-87693144-97e9-4888-81ed-8d597a95a8a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19245a9c-8e4c-406f-b0b8-1afbb5895c16", "name": "network-vif-deleted", "tag": "e65f96cc-fdef-4ae2-981c-67acf6f8f5ba"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:44:59.325848 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-21172364-ba7c-4bed-9a9c-72ad9f1c54eb req-87693144-97e9-4888-81ed-8d597a95a8a5 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:59.326324 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-21172364-ba7c-4bed-9a9c-72ad9f1c54eb req-87693144-97e9-4888-81ed-8d597a95a8a5 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:59.326744 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-21172364-ba7c-4bed-9a9c-72ad9f1c54eb req-87693144-97e9-4888-81ed-8d597a95a8a5 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:59.339144 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-21172364-ba7c-4bed-9a9c-72ad9f1c54eb req-87693144-97e9-4888-81ed-8d597a95a8a5 service nova] Creating event network-vif-deleted:e65f96cc-fdef-4ae2-981c-67acf6f8f5ba for instance 19245a9c-8e4c-406f-b0b8-1afbb5895c16 on hv-cinder-85220 Sep 06 22:44:59.344952 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-21172364-ba7c-4bed-9a9c-72ad9f1c54eb req-87693144-97e9-4888-81ed-8d597a95a8a5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032643 Sep 06 22:44:59.345549 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 157/308] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:44:59.370325 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-96508d6a-27b2-4daa-b84c-ff4ad5e043e2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:59.370930 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-96508d6a-27b2-4daa-b84c-ff4ad5e043e2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:59.377560 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-96508d6a-27b2-4daa-b84c-ff4ad5e043e2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:59.378040 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-96508d6a-27b2-4daa-b84c-ff4ad5e043e2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:59.378468 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-96508d6a-27b2-4daa-b84c-ff4ad5e043e2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:59.379168 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-96508d6a-27b2-4daa-b84c-ff4ad5e043e2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:59.379609 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-96508d6a-27b2-4daa-b84c-ff4ad5e043e2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:59.380028 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-96508d6a-27b2-4daa-b84c-ff4ad5e043e2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:59.512331 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-96508d6a-27b2-4daa-b84c-ff4ad5e043e2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:59.521275 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-96508d6a-27b2-4daa-b84c-ff4ad5e043e2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:59.522694 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-96508d6a-27b2-4daa-b84c-ff4ad5e043e2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:59.523862 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-96508d6a-27b2-4daa-b84c-ff4ad5e043e2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1723 microversion: 2.20 time: 0.157553 Sep 06 22:44:59.524417 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 152/309] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:44:59 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:44:59.884210 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-08f6eb45-7eef-4ca6-9e96-c04461ed4c7b tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:44:59.884853 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-08f6eb45-7eef-4ca6-9e96-c04461ed4c7b tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] [instance: 19245a9c-8e4c-406f-b0b8-1afbb5895c16] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:44:59.891571 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-08f6eb45-7eef-4ca6-9e96-c04461ed4c7b tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:59.892050 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-08f6eb45-7eef-4ca6-9e96-c04461ed4c7b tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:59.892478 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-08f6eb45-7eef-4ca6-9e96-c04461ed4c7b tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:59.893200 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-08f6eb45-7eef-4ca6-9e96-c04461ed4c7b tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:44:59.893644 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-08f6eb45-7eef-4ca6-9e96-c04461ed4c7b tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:44:59.894059 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-08f6eb45-7eef-4ca6-9e96-c04461ed4c7b tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:44:59.959438 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-08f6eb45-7eef-4ca6-9e96-c04461ed4c7b tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e73bc19084a4bab9727b9dda49b37c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0aee19677643cbbaeff056c8e5a2c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:44:59.966984 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-08f6eb45-7eef-4ca6-9e96-c04461ed4c7b tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] 10.222.0.39 "GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16" status: 200 len: 1427 microversion: 2.1 time: 0.087061 Sep 06 22:44:59.967544 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 158/310] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:44:59 2022] GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16 => generated 1427 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:00.245394 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1eb374e2-9779-4e9d-8e7c-d05fe05ec0bf tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:00.245995 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1eb374e2-9779-4e9d-8e7c-d05fe05ec0bf tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:00.253078 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1eb374e2-9779-4e9d-8e7c-d05fe05ec0bf tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:00.253562 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1eb374e2-9779-4e9d-8e7c-d05fe05ec0bf tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:00.254172 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1eb374e2-9779-4e9d-8e7c-d05fe05ec0bf tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:00.254868 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1eb374e2-9779-4e9d-8e7c-d05fe05ec0bf tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:00.255315 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1eb374e2-9779-4e9d-8e7c-d05fe05ec0bf tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:00.255731 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1eb374e2-9779-4e9d-8e7c-d05fe05ec0bf tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:00.255835 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-12b6e31c-d1ee-425d-a895-fcb33fed729c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:00.256544 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-12b6e31c-d1ee-425d-a895-fcb33fed729c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 5bcd7a9d-c2c8-489c-9827-b6be1508d63c] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:00.264556 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-12b6e31c-d1ee-425d-a895-fcb33fed729c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:00.265986 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-12b6e31c-d1ee-425d-a895-fcb33fed729c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:00.266803 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-12b6e31c-d1ee-425d-a895-fcb33fed729c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:00.267855 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-12b6e31c-d1ee-425d-a895-fcb33fed729c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:00.268534 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-12b6e31c-d1ee-425d-a895-fcb33fed729c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:00.269277 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-12b6e31c-d1ee-425d-a895-fcb33fed729c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:00.469284 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1eb374e2-9779-4e9d-8e7c-d05fe05ec0bf tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:00.477278 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-12b6e31c-d1ee-425d-a895-fcb33fed729c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:00.478937 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1eb374e2-9779-4e9d-8e7c-d05fe05ec0bf tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1724 microversion: 2.1 time: 0.238055 Sep 06 22:45:00.487177 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 153/311] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:00 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:00.487305 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-12b6e31c-d1ee-425d-a895-fcb33fed729c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c" status: 200 len: 1510 microversion: 2.1 time: 0.236186 Sep 06 22:45:00.487305 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 159/312] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:00 2022] GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c => generated 1510 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:00.553356 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-985382e8-59b1-4d19-b87f-5e7c5ebf1d94 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:00.556363 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-985382e8-59b1-4d19-b87f-5e7c5ebf1d94 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:00.563448 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-985382e8-59b1-4d19-b87f-5e7c5ebf1d94 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:00.564426 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-985382e8-59b1-4d19-b87f-5e7c5ebf1d94 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:00.564898 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-985382e8-59b1-4d19-b87f-5e7c5ebf1d94 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:00.565606 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-985382e8-59b1-4d19-b87f-5e7c5ebf1d94 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:00.566059 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-985382e8-59b1-4d19-b87f-5e7c5ebf1d94 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:00.566478 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-985382e8-59b1-4d19-b87f-5e7c5ebf1d94 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:00.707173 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-985382e8-59b1-4d19-b87f-5e7c5ebf1d94 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:00.715540 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-985382e8-59b1-4d19-b87f-5e7c5ebf1d94 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:00.717386 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-985382e8-59b1-4d19-b87f-5e7c5ebf1d94 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:00.719014 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-985382e8-59b1-4d19-b87f-5e7c5ebf1d94 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1723 microversion: 2.20 time: 0.170991 Sep 06 22:45:00.719827 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 154/313] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:00 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:45:00.991081 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-26e56939-8982-46fe-90e7-6bef3831efcc tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:00.991689 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-26e56939-8982-46fe-90e7-6bef3831efcc tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] [instance: 19245a9c-8e4c-406f-b0b8-1afbb5895c16] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:00.997585 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-26e56939-8982-46fe-90e7-6bef3831efcc tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:00.998065 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-26e56939-8982-46fe-90e7-6bef3831efcc tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:00.998493 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-26e56939-8982-46fe-90e7-6bef3831efcc tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:00.999175 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-26e56939-8982-46fe-90e7-6bef3831efcc tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:00.999629 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-26e56939-8982-46fe-90e7-6bef3831efcc tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:01.000658 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-26e56939-8982-46fe-90e7-6bef3831efcc tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:01.076636 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-26e56939-8982-46fe-90e7-6bef3831efcc tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e73bc19084a4bab9727b9dda49b37c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0aee19677643cbbaeff056c8e5a2c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:01.084687 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-26e56939-8982-46fe-90e7-6bef3831efcc tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] 10.222.0.39 "GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16" status: 200 len: 1299 microversion: 2.1 time: 0.097430 Sep 06 22:45:01.087488 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 160/314] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:00 2022] GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16 => generated 1299 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:01.511614 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d79d1198-5a8e-423d-833b-85688c090b96 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:01.516744 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-25cfa6a4-a247-453d-9fd2-8c739111be97 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:01.517519 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-25cfa6a4-a247-453d-9fd2-8c739111be97 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:01.517969 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-d79d1198-5a8e-423d-833b-85688c090b96 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 5bcd7a9d-c2c8-489c-9827-b6be1508d63c] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:01.530666 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25cfa6a4-a247-453d-9fd2-8c739111be97 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:01.532825 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d79d1198-5a8e-423d-833b-85688c090b96 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:01.533567 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d79d1198-5a8e-423d-833b-85688c090b96 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:01.534004 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d79d1198-5a8e-423d-833b-85688c090b96 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:01.534690 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d79d1198-5a8e-423d-833b-85688c090b96 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:01.535149 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d79d1198-5a8e-423d-833b-85688c090b96 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:01.535524 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d79d1198-5a8e-423d-833b-85688c090b96 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:01.537331 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25cfa6a4-a247-453d-9fd2-8c739111be97 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:01.537768 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25cfa6a4-a247-453d-9fd2-8c739111be97 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:01.538453 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25cfa6a4-a247-453d-9fd2-8c739111be97 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:01.538897 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25cfa6a4-a247-453d-9fd2-8c739111be97 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:01.539308 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25cfa6a4-a247-453d-9fd2-8c739111be97 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:01.743070 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-d79d1198-5a8e-423d-833b-85688c090b96 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:01.756736 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d79d1198-5a8e-423d-833b-85688c090b96 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c" status: 200 len: 1516 microversion: 2.1 time: 0.248678 Sep 06 22:45:01.758698 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 161/315] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:01 2022] GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c => generated 1516 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:01.765483 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-0966cbc1-6c65-4b25-b3cb-7db6ca8640ab tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:01.766923 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-0966cbc1-6c65-4b25-b3cb-7db6ca8640ab tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:01.775138 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0966cbc1-6c65-4b25-b3cb-7db6ca8640ab tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:01.776011 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0966cbc1-6c65-4b25-b3cb-7db6ca8640ab tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:01.776677 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0966cbc1-6c65-4b25-b3cb-7db6ca8640ab tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:01.777910 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0966cbc1-6c65-4b25-b3cb-7db6ca8640ab tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:01.778543 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0966cbc1-6c65-4b25-b3cb-7db6ca8640ab tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:01.779129 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0966cbc1-6c65-4b25-b3cb-7db6ca8640ab tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:01.801017 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-25cfa6a4-a247-453d-9fd2-8c739111be97 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:01.809816 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-25cfa6a4-a247-453d-9fd2-8c739111be97 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1724 microversion: 2.1 time: 0.309866 Sep 06 22:45:01.810726 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 155/316] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:01 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1724 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:01.959745 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-0966cbc1-6c65-4b25-b3cb-7db6ca8640ab tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:01.968008 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-0966cbc1-6c65-4b25-b3cb-7db6ca8640ab tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:01.970389 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-0966cbc1-6c65-4b25-b3cb-7db6ca8640ab tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:01.971536 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-0966cbc1-6c65-4b25-b3cb-7db6ca8640ab tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1723 microversion: 2.20 time: 0.211290 Sep 06 22:45:01.972088 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 162/317] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:01 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:45:02.107344 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-688cf9ba-9bba-41c8-9fd3-74fc9dec8dc7 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:02.108086 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-688cf9ba-9bba-41c8-9fd3-74fc9dec8dc7 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] [instance: 19245a9c-8e4c-406f-b0b8-1afbb5895c16] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:02.117002 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-688cf9ba-9bba-41c8-9fd3-74fc9dec8dc7 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:02.117002 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-688cf9ba-9bba-41c8-9fd3-74fc9dec8dc7 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:02.117002 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-688cf9ba-9bba-41c8-9fd3-74fc9dec8dc7 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:02.117599 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-688cf9ba-9bba-41c8-9fd3-74fc9dec8dc7 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:02.117981 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-688cf9ba-9bba-41c8-9fd3-74fc9dec8dc7 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:02.118225 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-688cf9ba-9bba-41c8-9fd3-74fc9dec8dc7 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:02.171671 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-688cf9ba-9bba-41c8-9fd3-74fc9dec8dc7 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:02.172914 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-688cf9ba-9bba-41c8-9fd3-74fc9dec8dc7 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:02.173378 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-688cf9ba-9bba-41c8-9fd3-74fc9dec8dc7 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:02.173861 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-688cf9ba-9bba-41c8-9fd3-74fc9dec8dc7 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lazy-loading 'fault' on Instance uuid 19245a9c-8e4c-406f-b0b8-1afbb5895c16 {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 22:45:02.223224 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-688cf9ba-9bba-41c8-9fd3-74fc9dec8dc7 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e73bc19084a4bab9727b9dda49b37c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0aee19677643cbbaeff056c8e5a2c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:02.235333 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-688cf9ba-9bba-41c8-9fd3-74fc9dec8dc7 tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] 10.222.0.39 "GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16" status: 200 len: 1304 microversion: 2.1 time: 0.131549 Sep 06 22:45:02.236367 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 156/318] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:02 2022] GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16 => generated 1304 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:45:02.837214 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-3ab9fdb4-e945-46ab-b65b-b3fb3ed988fd tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:02.838397 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-3ab9fdb4-e945-46ab-b65b-b3fb3ed988fd tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:02.847945 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3ab9fdb4-e945-46ab-b65b-b3fb3ed988fd tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:02.848701 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3ab9fdb4-e945-46ab-b65b-b3fb3ed988fd tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:02.849383 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3ab9fdb4-e945-46ab-b65b-b3fb3ed988fd tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:02.850317 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3ab9fdb4-e945-46ab-b65b-b3fb3ed988fd tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:02.850831 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3ab9fdb4-e945-46ab-b65b-b3fb3ed988fd tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:02.851313 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3ab9fdb4-e945-46ab-b65b-b3fb3ed988fd tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:02.869321 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-33b8f28f-badc-4e6f-8a14-0a7b668e35b4 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54410b9b-3862-4930-bce8-fba080be2ff5", "device": "/dev/sdb"}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:45:02.872535 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-33b8f28f-badc-4e6f-8a14-0a7b668e35b4 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c9f58e44-e53c-4224-9b62-a3c23ba54ade] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:02.893021 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-33b8f28f-badc-4e6f-8a14-0a7b668e35b4 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:02.893889 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-33b8f28f-badc-4e6f-8a14-0a7b668e35b4 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:02.894490 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-33b8f28f-badc-4e6f-8a14-0a7b668e35b4 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:02.895705 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-33b8f28f-badc-4e6f-8a14-0a7b668e35b4 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:02.896221 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-33b8f28f-badc-4e6f-8a14-0a7b668e35b4 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:02.897237 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-33b8f28f-badc-4e6f-8a14-0a7b668e35b4 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:03.035878 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3ab9fdb4-e945-46ab-b65b-b3fb3ed988fd tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:03.046346 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-3ab9fdb4-e945-46ab-b65b-b3fb3ed988fd tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1724 microversion: 2.1 time: 0.215080 Sep 06 22:45:03.049805 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 163/319] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:02 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:03.054820 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-8f7476dc-b5bc-49f3-b738-de6a85858f2f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:03.055427 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-8f7476dc-b5bc-49f3-b738-de6a85858f2f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:03.061865 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8f7476dc-b5bc-49f3-b738-de6a85858f2f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:03.062832 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8f7476dc-b5bc-49f3-b738-de6a85858f2f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:03.063463 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8f7476dc-b5bc-49f3-b738-de6a85858f2f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:03.064432 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8f7476dc-b5bc-49f3-b738-de6a85858f2f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:03.065197 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8f7476dc-b5bc-49f3-b738-de6a85858f2f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:03.065806 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8f7476dc-b5bc-49f3-b738-de6a85858f2f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:03.231268 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-33b8f28f-badc-4e6f-8a14-0a7b668e35b4 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "POST /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.366144 Sep 06 22:45:03.233084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 157/320] 10.222.0.39 () {60 vars in 1323 bytes} [Tue Sep 6 22:45:02 2022] POST /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade/os-volume_attachments => generated 194 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 22:45:03.235670 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-8f7476dc-b5bc-49f3-b738-de6a85858f2f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:03.240493 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=100 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:45:03.240881 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-42c6e380-6e6c-4ed9-b732-2257c197a6a8 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Action: 'create', calling method: .version_select at 0x7f9c4f8688b0>, body: {"keypair": {"name": "tempest-keypair-1585207196", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLojiGutqS5zRxHcWyU3Ws8oSoaw9kxTzogfMuZEL7azkC1f/jQQ/Ti0G/r8zHtPgZGyD86vNzidOptYU0fV+uqAH0/vC+Z8g5U+vL04oLoQB1HKWHTZ9Wu9JFb5SlsjTQ=="}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:45:03.251375 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-8f7476dc-b5bc-49f3-b738-de6a85858f2f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:03.255211 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-8f7476dc-b5bc-49f3-b738-de6a85858f2f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:03.257158 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-8f7476dc-b5bc-49f3-b738-de6a85858f2f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1744 microversion: 2.20 time: 0.205900 Sep 06 22:45:03.258303 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 164/321] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:03 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1744 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:45:03.260541 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-42c6e380-6e6c-4ed9-b732-2257c197a6a8 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Getting quotas for project 84c39ea86193481fa08158197629ea85. Resources: {'key_pairs'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 22:45:03.265001 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-42c6e380-6e6c-4ed9-b732-2257c197a6a8 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Getting quotas for user 2945d87f1c114dd0b42c4e58a8133e76 and project 84c39ea86193481fa08158197629ea85. Resources: {'key_pairs'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 22:45:03.274512 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-bf1c0454-1a6c-460c-b53c-873bb1899bfe tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:03.275916 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-bf1c0454-1a6c-460c-b53c-873bb1899bfe tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] [instance: 19245a9c-8e4c-406f-b0b8-1afbb5895c16] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:03.297999 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bf1c0454-1a6c-460c-b53c-873bb1899bfe tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:03.297999 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bf1c0454-1a6c-460c-b53c-873bb1899bfe tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:03.297999 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bf1c0454-1a6c-460c-b53c-873bb1899bfe tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:03.297999 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bf1c0454-1a6c-460c-b53c-873bb1899bfe tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:03.298448 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bf1c0454-1a6c-460c-b53c-873bb1899bfe tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:03.298448 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bf1c0454-1a6c-460c-b53c-873bb1899bfe tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:03.318091 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-bf1c0454-1a6c-460c-b53c-873bb1899bfe tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] HTTP exception thrown: Instance 19245a9c-8e4c-406f-b0b8-1afbb5895c16 could not be found. Sep 06 22:45:03.319950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-bf1c0454-1a6c-460c-b53c-873bb1899bfe tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Request method failure captured: Sep 06 22:45:03.319950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: request: GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16 HTTP/1.1 Sep 06 22:45:03.319950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept: application/json Sep 06 22:45:03.319950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Sep 06 22:45:03.319950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Connection: close Sep 06 22:45:03.319950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Length: 0 Sep 06 22:45:03.319950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Type: application/json Sep 06 22:45:03.319950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Host: 10.222.0.39 Sep 06 22:45:03.319950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Sep 06 22:45:03.319950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.12 Sep 06 22:45:03.319950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABjF81WPPuNEZgAw1U9HjSFkqR7hBnamOA7-3gG3wCbon-mmaZen3ClbFq9R-bC2RffsSYNSHjzJBxMKnfafOcag_fOH6lw-uTJflvySrt3c5FmAfvzcFZeLJC9SApBRQZsVgtc8-vbUqJoztlb7Bd_-g9lb4_KkkgsQyJdhoyr3JoXi2Y Sep 06 22:45:03.319950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Sep 06 22:45:03.319950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Sep 06 22:45:03.319950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Sep 06 22:45:03.319950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Sep 06 22:45:03.319950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Sep 06 22:45:03.319950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Sep 06 22:45:03.319950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Id: ad0aee19677643cbbaeff056c8e5a2c4 Sep 06 22:45:03.319950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-VolumesNegativeTest-535364029 Sep 06 22:45:03.319950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Role: reader,member Sep 06 22:45:03.319950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Sep 06 22:45:03.321540 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ad0aee19677643cbbaeff056c8e5a2c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ad0aee19677643cbbaeff056c8e5a2c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ad0aee19677643cbbaeff056c8e5a2c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ad0aee19677643cbbaeff056c8e5a2c4"}]}] Sep 06 22:45:03.321540 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-VolumesNegativeTest-535364029 Sep 06 22:45:03.321540 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Id: ad0aee19677643cbbaeff056c8e5a2c4 Sep 06 22:45:03.321540 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-VolumesNegativeTest-535364029 Sep 06 22:45:03.321540 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User: tempest-VolumesNegativeTest-535364029-project Sep 06 22:45:03.321540 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Sep 06 22:45:03.321540 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Sep 06 22:45:03.321540 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Id: 1e73bc19084a4bab9727b9dda49b37c6 Sep 06 22:45:03.321540 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-VolumesNegativeTest-535364029-project Sep 06 22:45:03.321540 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: method: > Sep 06 22:45:03.321540 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: exception: Instance 19245a9c-8e4c-406f-b0b8-1afbb5895c16 could not be found. Sep 06 22:45:03.321540 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: action_args: {'id': '19245a9c-8e4c-406f-b0b8-1afbb5895c16'} Sep 06 22:45:03.322372 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:45:03.322372 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:45:03.322372 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:45:03.322372 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:45:03.322372 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:45:03.322372 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:45:03.322372 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:45:03.322372 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:45:03.322372 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:45:03.322372 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:45:03.322372 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19245a9c-8e4c-406f-b0b8-1afbb5895c16 could not be found. Sep 06 22:45:03.322372 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:45:03.322372 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:45:03.322372 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:45:03.322372 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:45:03.322372 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:45:03.322372 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:45:03.322372 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:45:03.322372 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:45:03.322372 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:45:03.323699 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:45:03.323699 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 22:45:03.323699 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 22:45:03.323699 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:45:03.323699 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:45:03.323699 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:45:03.323699 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:45:03.323699 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19245a9c-8e4c-406f-b0b8-1afbb5895c16 could not be found. Sep 06 22:45:03.323699 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:45:03.323699 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:45:03.323699 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:45:03.323699 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:45:03.323699 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:45:03.323699 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:45:03.323699 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:45:03.323699 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:45:03.323699 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19245a9c-8e4c-406f-b0b8-1afbb5895c16 could not be found. Sep 06 22:45:03.323699 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:45:03.325080 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-bf1c0454-1a6c-460c-b53c-873bb1899bfe tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] Returning 404 to user: Instance 19245a9c-8e4c-406f-b0b8-1afbb5895c16 could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:45:03.325080 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-bf1c0454-1a6c-460c-b53c-873bb1899bfe tempest-VolumesNegativeTest-535364029 tempest-VolumesNegativeTest-535364029-project] 10.222.0.39 "GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16" status: 404 len: 111 microversion: 2.1 time: 0.062168 Sep 06 22:45:03.325080 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 165/322] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:03 2022] GET /compute/v2.1/servers/19245a9c-8e4c-406f-b0b8-1afbb5895c16 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 22:45:03.327042 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-42c6e380-6e6c-4ed9-b732-2257c197a6a8 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.092742 Sep 06 22:45:03.330156 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 158/323] 10.222.0.39 () {60 vars in 1159 bytes} [Tue Sep 6 22:45:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:45:04.072292 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-fb819879-8078-4fb5-9f2b-dbfe3f11a0b9 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:04.074241 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-fb819879-8078-4fb5-9f2b-dbfe3f11a0b9 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:04.082388 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fb819879-8078-4fb5-9f2b-dbfe3f11a0b9 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:04.083169 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fb819879-8078-4fb5-9f2b-dbfe3f11a0b9 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:04.083692 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fb819879-8078-4fb5-9f2b-dbfe3f11a0b9 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:04.084630 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fb819879-8078-4fb5-9f2b-dbfe3f11a0b9 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:04.085310 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fb819879-8078-4fb5-9f2b-dbfe3f11a0b9 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:04.086011 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fb819879-8078-4fb5-9f2b-dbfe3f11a0b9 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:04.288365 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-537dd13c-7230-47ca-9467-bcbe86fe9443 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:04.289994 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-537dd13c-7230-47ca-9467-bcbe86fe9443 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:04.307076 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-fb819879-8078-4fb5-9f2b-dbfe3f11a0b9 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:04.322921 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-537dd13c-7230-47ca-9467-bcbe86fe9443 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:04.323719 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-537dd13c-7230-47ca-9467-bcbe86fe9443 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:04.325041 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-537dd13c-7230-47ca-9467-bcbe86fe9443 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:04.325395 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-fb819879-8078-4fb5-9f2b-dbfe3f11a0b9 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1724 microversion: 2.1 time: 0.254211 Sep 06 22:45:04.326315 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 166/324] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:04 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1724 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:04.332185 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-537dd13c-7230-47ca-9467-bcbe86fe9443 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:04.332707 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-537dd13c-7230-47ca-9467-bcbe86fe9443 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:04.333164 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-537dd13c-7230-47ca-9467-bcbe86fe9443 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:04.601790 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-537dd13c-7230-47ca-9467-bcbe86fe9443 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:04.631612 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-537dd13c-7230-47ca-9467-bcbe86fe9443 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:04.648567 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-537dd13c-7230-47ca-9467-bcbe86fe9443 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:04.652546 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-537dd13c-7230-47ca-9467-bcbe86fe9443 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1744 microversion: 2.20 time: 0.369540 Sep 06 22:45:04.653042 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 159/325] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:04 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1744 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 22:45:05.259725 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b321873e-66e4-48d9-bffb-c30976e33d29 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1856517530", "imageRef": "93326d5e-4826-431e-9ad1-6ee2d44e48d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "06b475d5-934b-4826-b952-a6c0a64b3745"}], "security_groups": [{"name": "tempest-securitygroup--715138340"}], "key_name": "tempest-keypair-1585207196", "user_data": "}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:45:05.353162 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e4325662-a611-4910-9177-a73edba1c433 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:05.353795 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e4325662-a611-4910-9177-a73edba1c433 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:05.367383 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e4325662-a611-4910-9177-a73edba1c433 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:05.369701 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e4325662-a611-4910-9177-a73edba1c433 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:05.370242 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e4325662-a611-4910-9177-a73edba1c433 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:05.371233 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e4325662-a611-4910-9177-a73edba1c433 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:05.375280 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e4325662-a611-4910-9177-a73edba1c433 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:05.376422 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e4325662-a611-4910-9177-a73edba1c433 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:05.473753 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.network.neutron [None req-b321873e-66e4-48d9-bffb-c30976e33d29 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] validate_networks() for [('06b475d5-934b-4826-b952-a6c0a64b3745', None, None, None, None, None)] {{(pid=127087) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 22:45:05.765016 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e4325662-a611-4910-9177-a73edba1c433 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:05.775697 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e4325662-a611-4910-9177-a73edba1c433 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1724 microversion: 2.1 time: 0.427041 Sep 06 22:45:05.776681 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 160/326] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:05 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1724 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:45:05.783396 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7438467b-4245-4662-ab26-66037f886428 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:05.784352 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7438467b-4245-4662-ab26-66037f886428 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:05.800988 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7438467b-4245-4662-ab26-66037f886428 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:05.801768 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7438467b-4245-4662-ab26-66037f886428 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:05.802247 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7438467b-4245-4662-ab26-66037f886428 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:05.804382 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7438467b-4245-4662-ab26-66037f886428 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:05.804880 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7438467b-4245-4662-ab26-66037f886428 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:05.806397 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7438467b-4245-4662-ab26-66037f886428 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:06.088979 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7438467b-4245-4662-ab26-66037f886428 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:06.102258 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7438467b-4245-4662-ab26-66037f886428 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:06.103811 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7438467b-4245-4662-ab26-66037f886428 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:06.105098 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7438467b-4245-4662-ab26-66037f886428 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1739 microversion: 2.20 time: 0.327138 Sep 06 22:45:06.105733 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 161/327] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:05 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1739 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:45:06.152957 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-b321873e-66e4-48d9-bffb-c30976e33d29 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Flavor limits 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 22:45:06.153478 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-b321873e-66e4-48d9-bffb-c30976e33d29 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Image limits 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 22:45:06.154048 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-b321873e-66e4-48d9-bffb-c30976e33d29 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Flavor pref 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 22:45:06.154515 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-b321873e-66e4-48d9-bffb-c30976e33d29 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Image pref 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 22:45:06.154983 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-b321873e-66e4-48d9-bffb-c30976e33d29 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 22:45:06.168374 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b321873e-66e4-48d9-bffb-c30976e33d29 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:06.169078 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b321873e-66e4-48d9-bffb-c30976e33d29 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:06.169727 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b321873e-66e4-48d9-bffb-c30976e33d29 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:06.170607 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b321873e-66e4-48d9-bffb-c30976e33d29 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:06.171978 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b321873e-66e4-48d9-bffb-c30976e33d29 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:06.172645 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b321873e-66e4-48d9-bffb-c30976e33d29 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:06.195028 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-b321873e-66e4-48d9-bffb-c30976e33d29 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Getting quotas for project 84c39ea86193481fa08158197629ea85. Resources: {'instances', 'ram', 'cores'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 22:45:06.199595 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-b321873e-66e4-48d9-bffb-c30976e33d29 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Getting quotas for user 2945d87f1c114dd0b42c4e58a8133e76 and project 84c39ea86193481fa08158197629ea85. Resources: {'instances', 'ram', 'cores'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 22:45:06.212831 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b321873e-66e4-48d9-bffb-c30976e33d29 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Going to run 1 instances... {{(pid=127087) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 22:45:06.215547 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b321873e-66e4-48d9-bffb-c30976e33d29 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='93326d5e-4826-431e-9ad1-6ee2d44e48d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 22:45:06.281758 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b321873e-66e4-48d9-bffb-c30976e33d29 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.026272 Sep 06 22:45:06.284257 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 167/328] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Sep 6 22:45:05 2022] POST /compute/v2.1/servers => generated 408 bytes in 1028 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 22:45:06.295363 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-084835c0-3c92-47e0-9898-10228b2bfe82 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:06.302127 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-084835c0-3c92-47e0-9898-10228b2bfe82 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:06.450301 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-084835c0-3c92-47e0-9898-10228b2bfe82 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:06.461127 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-084835c0-3c92-47e0-9898-10228b2bfe82 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1246 microversion: 2.1 time: 0.169614 Sep 06 22:45:06.462468 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 162/329] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:06 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1246 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:06.801366 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-4ec8cd0b-c343-4847-b365-3052e1ee0416 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:06.802578 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-4ec8cd0b-c343-4847-b365-3052e1ee0416 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:06.817639 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4ec8cd0b-c343-4847-b365-3052e1ee0416 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:06.819234 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4ec8cd0b-c343-4847-b365-3052e1ee0416 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:06.820037 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4ec8cd0b-c343-4847-b365-3052e1ee0416 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:06.821161 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4ec8cd0b-c343-4847-b365-3052e1ee0416 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:06.821831 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4ec8cd0b-c343-4847-b365-3052e1ee0416 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:06.822503 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4ec8cd0b-c343-4847-b365-3052e1ee0416 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:07.032363 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-4ec8cd0b-c343-4847-b365-3052e1ee0416 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:07.041681 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-4ec8cd0b-c343-4847-b365-3052e1ee0416 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1724 microversion: 2.1 time: 0.245802 Sep 06 22:45:07.042318 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 168/330] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:06 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:07.138610 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1fdfffa1-bd53-4ed8-862e-c5a93f290e67 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:07.139513 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1fdfffa1-bd53-4ed8-862e-c5a93f290e67 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:07.162156 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1fdfffa1-bd53-4ed8-862e-c5a93f290e67 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:07.163015 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1fdfffa1-bd53-4ed8-862e-c5a93f290e67 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:07.163698 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1fdfffa1-bd53-4ed8-862e-c5a93f290e67 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:07.164587 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1fdfffa1-bd53-4ed8-862e-c5a93f290e67 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:07.165657 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1fdfffa1-bd53-4ed8-862e-c5a93f290e67 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:07.182340 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1fdfffa1-bd53-4ed8-862e-c5a93f290e67 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:07.240706 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-de849351-5c97-4415-a160-f1380cec743c req-e5a4906a-c842-4795-b2a7-4fef548b20b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13ef5db2-b5d1-41af-8c93-2851abb0b6dd", "name": "network-vif-plugged", "status": "completed", "tag": "2130f481-0970-42ca-bbc5-20da06de6a04"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:45:07.254473 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-de849351-5c97-4415-a160-f1380cec743c req-e5a4906a-c842-4795-b2a7-4fef548b20b0 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:07.254763 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-de849351-5c97-4415-a160-f1380cec743c req-e5a4906a-c842-4795-b2a7-4fef548b20b0 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:07.255419 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-de849351-5c97-4415-a160-f1380cec743c req-e5a4906a-c842-4795-b2a7-4fef548b20b0 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:07.279250 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-de849351-5c97-4415-a160-f1380cec743c req-e5a4906a-c842-4795-b2a7-4fef548b20b0 service nova] Creating event network-vif-plugged:2130f481-0970-42ca-bbc5-20da06de6a04 for instance 13ef5db2-b5d1-41af-8c93-2851abb0b6dd on hv-cinder-85220 Sep 06 22:45:07.297286 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-de849351-5c97-4415-a160-f1380cec743c req-e5a4906a-c842-4795-b2a7-4fef548b20b0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060013 Sep 06 22:45:07.299008 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 169/331] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:45:07.486486 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1fdfffa1-bd53-4ed8-862e-c5a93f290e67 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:07.486981 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a130684d-4ffc-4db2-87e2-6fcc74a6d923 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:07.489604 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-a130684d-4ffc-4db2-87e2-6fcc74a6d923 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:07.496291 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a130684d-4ffc-4db2-87e2-6fcc74a6d923 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:07.498476 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a130684d-4ffc-4db2-87e2-6fcc74a6d923 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:07.500182 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a130684d-4ffc-4db2-87e2-6fcc74a6d923 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:07.501267 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a130684d-4ffc-4db2-87e2-6fcc74a6d923 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:07.501953 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a130684d-4ffc-4db2-87e2-6fcc74a6d923 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:07.502101 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1fdfffa1-bd53-4ed8-862e-c5a93f290e67 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:07.502828 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a130684d-4ffc-4db2-87e2-6fcc74a6d923 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:07.504933 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1fdfffa1-bd53-4ed8-862e-c5a93f290e67 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:07.506148 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1fdfffa1-bd53-4ed8-862e-c5a93f290e67 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1739 microversion: 2.20 time: 0.372432 Sep 06 22:45:07.506776 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 163/332] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:07 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1739 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:45:07.610380 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-a130684d-4ffc-4db2-87e2-6fcc74a6d923 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:07.629812 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-a130684d-4ffc-4db2-87e2-6fcc74a6d923 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1298 microversion: 2.1 time: 0.148591 Sep 06 22:45:07.638024 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 170/333] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:07 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1298 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:08.069338 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e4c65d33-9db1-4fae-9533-6c85dc160ba2 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:08.069536 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e4c65d33-9db1-4fae-9533-6c85dc160ba2 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:08.080821 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e4c65d33-9db1-4fae-9533-6c85dc160ba2 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:08.083061 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e4c65d33-9db1-4fae-9533-6c85dc160ba2 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:08.083948 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e4c65d33-9db1-4fae-9533-6c85dc160ba2 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:08.085137 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e4c65d33-9db1-4fae-9533-6c85dc160ba2 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:08.086035 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e4c65d33-9db1-4fae-9533-6c85dc160ba2 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:08.086726 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e4c65d33-9db1-4fae-9533-6c85dc160ba2 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:08.278990 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e4c65d33-9db1-4fae-9533-6c85dc160ba2 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:08.290555 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e4c65d33-9db1-4fae-9533-6c85dc160ba2 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1724 microversion: 2.1 time: 0.226202 Sep 06 22:45:08.292062 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 164/334] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:08 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:08.541005 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-0cbf004e-a5f0-49c7-a8ff-c1cccef8e5e5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:08.542365 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-0cbf004e-a5f0-49c7-a8ff-c1cccef8e5e5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:08.563019 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0cbf004e-a5f0-49c7-a8ff-c1cccef8e5e5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:08.563854 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0cbf004e-a5f0-49c7-a8ff-c1cccef8e5e5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:08.565061 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0cbf004e-a5f0-49c7-a8ff-c1cccef8e5e5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:08.566099 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0cbf004e-a5f0-49c7-a8ff-c1cccef8e5e5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:08.566698 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0cbf004e-a5f0-49c7-a8ff-c1cccef8e5e5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:08.567310 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0cbf004e-a5f0-49c7-a8ff-c1cccef8e5e5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:08.664061 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ccafcb10-dbeb-42e9-ac2e-e4ec35da552e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:08.665671 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ccafcb10-dbeb-42e9-ac2e-e4ec35da552e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:08.673755 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ccafcb10-dbeb-42e9-ac2e-e4ec35da552e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:08.674798 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ccafcb10-dbeb-42e9-ac2e-e4ec35da552e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:08.675536 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ccafcb10-dbeb-42e9-ac2e-e4ec35da552e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:08.677057 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ccafcb10-dbeb-42e9-ac2e-e4ec35da552e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:08.678297 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ccafcb10-dbeb-42e9-ac2e-e4ec35da552e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:08.678932 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ccafcb10-dbeb-42e9-ac2e-e4ec35da552e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:08.862196 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ccafcb10-dbeb-42e9-ac2e-e4ec35da552e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:08.862196 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ccafcb10-dbeb-42e9-ac2e-e4ec35da552e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1304 microversion: 2.1 time: 0.201609 Sep 06 22:45:08.862570 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 165/335] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:08 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1304 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:45:09.033675 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-0cbf004e-a5f0-49c7-a8ff-c1cccef8e5e5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:09.044804 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-0cbf004e-a5f0-49c7-a8ff-c1cccef8e5e5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:09.046338 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-0cbf004e-a5f0-49c7-a8ff-c1cccef8e5e5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:09.047515 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-0cbf004e-a5f0-49c7-a8ff-c1cccef8e5e5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1739 microversion: 2.20 time: 0.515491 Sep 06 22:45:09.060783 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 171/336] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:08 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1739 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:45:09.319504 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-182e3603-b2c1-4b3a-b479-42e02a7dcafc tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:09.320034 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-182e3603-b2c1-4b3a-b479-42e02a7dcafc tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:09.326257 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-182e3603-b2c1-4b3a-b479-42e02a7dcafc tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:09.326914 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-182e3603-b2c1-4b3a-b479-42e02a7dcafc tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:09.327616 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-182e3603-b2c1-4b3a-b479-42e02a7dcafc tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:09.328702 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-182e3603-b2c1-4b3a-b479-42e02a7dcafc tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:09.329506 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-182e3603-b2c1-4b3a-b479-42e02a7dcafc tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:09.330169 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-182e3603-b2c1-4b3a-b479-42e02a7dcafc tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:09.519966 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-182e3603-b2c1-4b3a-b479-42e02a7dcafc tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:09.534252 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-182e3603-b2c1-4b3a-b479-42e02a7dcafc tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1724 microversion: 2.1 time: 0.217314 Sep 06 22:45:09.552909 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 166/337] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:09 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:09.896340 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-0f69f13e-c7dc-4811-9eb7-99db30251c21 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:09.897847 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-0f69f13e-c7dc-4811-9eb7-99db30251c21 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:09.905020 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0f69f13e-c7dc-4811-9eb7-99db30251c21 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:09.910681 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0f69f13e-c7dc-4811-9eb7-99db30251c21 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:09.911434 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0f69f13e-c7dc-4811-9eb7-99db30251c21 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:09.912366 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0f69f13e-c7dc-4811-9eb7-99db30251c21 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:09.913098 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0f69f13e-c7dc-4811-9eb7-99db30251c21 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:09.913862 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0f69f13e-c7dc-4811-9eb7-99db30251c21 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:10.042050 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-0f69f13e-c7dc-4811-9eb7-99db30251c21 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:10.048434 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-0f69f13e-c7dc-4811-9eb7-99db30251c21 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1304 microversion: 2.1 time: 0.156097 Sep 06 22:45:10.049504 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 172/338] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:09 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1304 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:45:10.086507 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f100a4e4-0f88-443d-8fae-cff678453cec tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:10.087221 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f100a4e4-0f88-443d-8fae-cff678453cec tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:10.105986 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f100a4e4-0f88-443d-8fae-cff678453cec tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:10.112022 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f100a4e4-0f88-443d-8fae-cff678453cec tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:10.112968 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f100a4e4-0f88-443d-8fae-cff678453cec tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:10.114809 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f100a4e4-0f88-443d-8fae-cff678453cec tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:10.115480 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f100a4e4-0f88-443d-8fae-cff678453cec tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:10.129238 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f100a4e4-0f88-443d-8fae-cff678453cec tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:10.474770 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f100a4e4-0f88-443d-8fae-cff678453cec tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:10.483384 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f100a4e4-0f88-443d-8fae-cff678453cec tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:10.485676 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f100a4e4-0f88-443d-8fae-cff678453cec tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:10.488409 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f100a4e4-0f88-443d-8fae-cff678453cec tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1739 microversion: 2.20 time: 0.406071 Sep 06 22:45:10.505172 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 167/339] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:10 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1739 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:45:10.580816 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-45aa69ef-b3d9-4845-8338-b22b4af14c7f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:10.581672 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-45aa69ef-b3d9-4845-8338-b22b4af14c7f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:10.597034 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-45aa69ef-b3d9-4845-8338-b22b4af14c7f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:10.597914 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-45aa69ef-b3d9-4845-8338-b22b4af14c7f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:10.599172 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-45aa69ef-b3d9-4845-8338-b22b4af14c7f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:10.603031 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-45aa69ef-b3d9-4845-8338-b22b4af14c7f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:10.603668 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-45aa69ef-b3d9-4845-8338-b22b4af14c7f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:10.604272 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-45aa69ef-b3d9-4845-8338-b22b4af14c7f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:11.082426 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6955fb97-69f2-413f-adfe-74c17c6970b9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:11.084242 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6955fb97-69f2-413f-adfe-74c17c6970b9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:11.096090 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6955fb97-69f2-413f-adfe-74c17c6970b9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:11.100185 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6955fb97-69f2-413f-adfe-74c17c6970b9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:11.104125 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6955fb97-69f2-413f-adfe-74c17c6970b9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:11.113734 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6955fb97-69f2-413f-adfe-74c17c6970b9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:11.113734 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6955fb97-69f2-413f-adfe-74c17c6970b9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:11.114169 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6955fb97-69f2-413f-adfe-74c17c6970b9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:11.119503 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:45:11.138374 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-45aa69ef-b3d9-4845-8338-b22b4af14c7f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:11.161522 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-45aa69ef-b3d9-4845-8338-b22b4af14c7f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1724 microversion: 2.1 time: 0.601574 Sep 06 22:45:11.162551 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 173/340] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:10 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1724 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:11.422431 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6955fb97-69f2-413f-adfe-74c17c6970b9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:11.431420 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6955fb97-69f2-413f-adfe-74c17c6970b9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1371 microversion: 2.1 time: 0.360425 Sep 06 22:45:11.441026 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 168/341] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:11 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1371 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:11.517534 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-18fef50f-1cae-47ff-b9cd-a886e80927bd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:11.518896 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-18fef50f-1cae-47ff-b9cd-a886e80927bd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:11.529212 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-18fef50f-1cae-47ff-b9cd-a886e80927bd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:11.529987 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-18fef50f-1cae-47ff-b9cd-a886e80927bd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:11.530587 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-18fef50f-1cae-47ff-b9cd-a886e80927bd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:11.532096 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-18fef50f-1cae-47ff-b9cd-a886e80927bd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:11.533138 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-18fef50f-1cae-47ff-b9cd-a886e80927bd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:11.533968 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-18fef50f-1cae-47ff-b9cd-a886e80927bd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:11.826878 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-18fef50f-1cae-47ff-b9cd-a886e80927bd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:11.842167 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-18fef50f-1cae-47ff-b9cd-a886e80927bd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:11.845110 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-18fef50f-1cae-47ff-b9cd-a886e80927bd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:11.846597 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-18fef50f-1cae-47ff-b9cd-a886e80927bd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1739 microversion: 2.20 time: 0.334107 Sep 06 22:45:11.851014 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 174/342] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:11 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1739 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:45:12.098469 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-57ef4343-55e2-4749-b061-3d307612b5e7 req-b1d70083-ff76-432c-8d96-3aa2d2db45a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b07b208-45e2-45aa-ad7b-bede527cfb6d", "tag": "bc5d6b1f-b033-4efc-ac9f-ff0f920a565c"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:45:12.125015 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-57ef4343-55e2-4749-b061-3d307612b5e7 req-b1d70083-ff76-432c-8d96-3aa2d2db45a5 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:12.125802 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-57ef4343-55e2-4749-b061-3d307612b5e7 req-b1d70083-ff76-432c-8d96-3aa2d2db45a5 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:12.128242 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-57ef4343-55e2-4749-b061-3d307612b5e7 req-b1d70083-ff76-432c-8d96-3aa2d2db45a5 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:12.148268 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-57ef4343-55e2-4749-b061-3d307612b5e7 req-b1d70083-ff76-432c-8d96-3aa2d2db45a5 service nova] Creating event network-changed:bc5d6b1f-b033-4efc-ac9f-ff0f920a565c for instance 7b07b208-45e2-45aa-ad7b-bede527cfb6d on hv-cinder-85220 Sep 06 22:45:12.154186 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-57ef4343-55e2-4749-b061-3d307612b5e7 req-b1d70083-ff76-432c-8d96-3aa2d2db45a5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060179 Sep 06 22:45:12.155908 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 169/343] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:45:12.189577 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-60578ed9-30cc-4924-9ac2-ebee9da0a10b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:12.191057 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-60578ed9-30cc-4924-9ac2-ebee9da0a10b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:12.198448 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-60578ed9-30cc-4924-9ac2-ebee9da0a10b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:12.198997 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-60578ed9-30cc-4924-9ac2-ebee9da0a10b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:12.199431 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-60578ed9-30cc-4924-9ac2-ebee9da0a10b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:12.200347 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-60578ed9-30cc-4924-9ac2-ebee9da0a10b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:12.200858 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-60578ed9-30cc-4924-9ac2-ebee9da0a10b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:12.201471 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-60578ed9-30cc-4924-9ac2-ebee9da0a10b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:12.376965 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-60578ed9-30cc-4924-9ac2-ebee9da0a10b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:12.390687 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-60578ed9-30cc-4924-9ac2-ebee9da0a10b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1724 microversion: 2.1 time: 0.206929 Sep 06 22:45:12.392778 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 175/344] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:12 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:12.464607 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2192f9a1-6c0b-4a8d-a3ab-316ec213d113 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:12.465877 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2192f9a1-6c0b-4a8d-a3ab-316ec213d113 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:12.473962 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2192f9a1-6c0b-4a8d-a3ab-316ec213d113 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:12.474795 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2192f9a1-6c0b-4a8d-a3ab-316ec213d113 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:12.475605 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2192f9a1-6c0b-4a8d-a3ab-316ec213d113 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:12.476716 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2192f9a1-6c0b-4a8d-a3ab-316ec213d113 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:12.477538 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2192f9a1-6c0b-4a8d-a3ab-316ec213d113 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:12.478176 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2192f9a1-6c0b-4a8d-a3ab-316ec213d113 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:12.654242 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2192f9a1-6c0b-4a8d-a3ab-316ec213d113 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:12.662938 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2192f9a1-6c0b-4a8d-a3ab-316ec213d113 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1371 microversion: 2.1 time: 0.202962 Sep 06 22:45:12.663519 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 170/345] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:12 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1371 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:12.877106 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-aabe1561-9aa0-4554-bb52-5679922c5cf2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:12.881642 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-aabe1561-9aa0-4554-bb52-5679922c5cf2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:12.895936 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-aabe1561-9aa0-4554-bb52-5679922c5cf2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:12.896831 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-aabe1561-9aa0-4554-bb52-5679922c5cf2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:12.897491 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-aabe1561-9aa0-4554-bb52-5679922c5cf2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:12.898550 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-aabe1561-9aa0-4554-bb52-5679922c5cf2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:12.899214 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-aabe1561-9aa0-4554-bb52-5679922c5cf2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:12.901296 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-aabe1561-9aa0-4554-bb52-5679922c5cf2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:13.259978 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-aabe1561-9aa0-4554-bb52-5679922c5cf2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:13.272001 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-aabe1561-9aa0-4554-bb52-5679922c5cf2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:13.273807 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-aabe1561-9aa0-4554-bb52-5679922c5cf2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:13.275189 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-aabe1561-9aa0-4554-bb52-5679922c5cf2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1739 microversion: 2.20 time: 0.403244 Sep 06 22:45:13.276424 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 176/346] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:12 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1739 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:45:13.424929 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a7cee1f8-a882-4ec6-b27a-6e880b1cb614 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:13.426948 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a7cee1f8-a882-4ec6-b27a-6e880b1cb614 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:13.435483 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:45:13.441180 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a7cee1f8-a882-4ec6-b27a-6e880b1cb614 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:13.442463 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a7cee1f8-a882-4ec6-b27a-6e880b1cb614 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:13.443292 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a7cee1f8-a882-4ec6-b27a-6e880b1cb614 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:13.444971 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a7cee1f8-a882-4ec6-b27a-6e880b1cb614 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:13.445649 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a7cee1f8-a882-4ec6-b27a-6e880b1cb614 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:13.446289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a7cee1f8-a882-4ec6-b27a-6e880b1cb614 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:13.687632 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-8864c104-0baa-4261-9196-bff3dc40b708 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:13.688647 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-8864c104-0baa-4261-9196-bff3dc40b708 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:13.700381 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8864c104-0baa-4261-9196-bff3dc40b708 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:13.700912 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8864c104-0baa-4261-9196-bff3dc40b708 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:13.701772 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8864c104-0baa-4261-9196-bff3dc40b708 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:13.702033 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8864c104-0baa-4261-9196-bff3dc40b708 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:13.702496 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8864c104-0baa-4261-9196-bff3dc40b708 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:13.702946 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8864c104-0baa-4261-9196-bff3dc40b708 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:13.868446 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a7cee1f8-a882-4ec6-b27a-6e880b1cb614 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:13.882316 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a7cee1f8-a882-4ec6-b27a-6e880b1cb614 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1724 microversion: 2.1 time: 0.466416 Sep 06 22:45:13.883156 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 171/347] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:13 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1724 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:45:14.045499 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-8864c104-0baa-4261-9196-bff3dc40b708 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:14.057425 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-8864c104-0baa-4261-9196-bff3dc40b708 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1371 microversion: 2.1 time: 0.374188 Sep 06 22:45:14.058338 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 177/348] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:13 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1371 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:45:14.304600 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-10ba8ee4-8337-4f49-af8c-21f55ef23fd3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:14.305279 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-10ba8ee4-8337-4f49-af8c-21f55ef23fd3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:14.313092 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-10ba8ee4-8337-4f49-af8c-21f55ef23fd3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:14.313684 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-10ba8ee4-8337-4f49-af8c-21f55ef23fd3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:14.314425 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-10ba8ee4-8337-4f49-af8c-21f55ef23fd3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:14.315217 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-10ba8ee4-8337-4f49-af8c-21f55ef23fd3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:14.315764 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-10ba8ee4-8337-4f49-af8c-21f55ef23fd3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:14.316749 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-10ba8ee4-8337-4f49-af8c-21f55ef23fd3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:14.810149 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-10ba8ee4-8337-4f49-af8c-21f55ef23fd3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:14.822225 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-10ba8ee4-8337-4f49-af8c-21f55ef23fd3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:14.824107 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-10ba8ee4-8337-4f49-af8c-21f55ef23fd3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:14.825581 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-10ba8ee4-8337-4f49-af8c-21f55ef23fd3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1739 microversion: 2.20 time: 0.524916 Sep 06 22:45:14.826315 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 172/349] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:14 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1739 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:45:14.907606 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-adec0e5a-51bb-4d2b-8443-6c3417957542 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:14.916282 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-adec0e5a-51bb-4d2b-8443-6c3417957542 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:14.923510 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-adec0e5a-51bb-4d2b-8443-6c3417957542 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:14.924307 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-adec0e5a-51bb-4d2b-8443-6c3417957542 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:14.925003 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-adec0e5a-51bb-4d2b-8443-6c3417957542 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:14.925920 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-adec0e5a-51bb-4d2b-8443-6c3417957542 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:14.926568 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-adec0e5a-51bb-4d2b-8443-6c3417957542 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:14.927197 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-adec0e5a-51bb-4d2b-8443-6c3417957542 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:15.081531 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8f335e02-002f-4189-a3e8-7ebf426dd70c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:15.083311 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8f335e02-002f-4189-a3e8-7ebf426dd70c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:15.101941 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f335e02-002f-4189-a3e8-7ebf426dd70c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:15.116538 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f335e02-002f-4189-a3e8-7ebf426dd70c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:15.117013 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f335e02-002f-4189-a3e8-7ebf426dd70c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:15.117758 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f335e02-002f-4189-a3e8-7ebf426dd70c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:15.118398 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f335e02-002f-4189-a3e8-7ebf426dd70c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:15.119147 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f335e02-002f-4189-a3e8-7ebf426dd70c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:15.884606 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-adec0e5a-51bb-4d2b-8443-6c3417957542 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:15.900455 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-adec0e5a-51bb-4d2b-8443-6c3417957542 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1724 microversion: 2.1 time: 0.997546 Sep 06 22:45:15.903278 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 178/350] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:14 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1724 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:15.912281 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f969c670-a121-4c72-b46d-9f1b13603782 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:15.916966 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-f969c670-a121-4c72-b46d-9f1b13603782 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:15.932731 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f969c670-a121-4c72-b46d-9f1b13603782 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:15.934155 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f969c670-a121-4c72-b46d-9f1b13603782 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:15.934619 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f969c670-a121-4c72-b46d-9f1b13603782 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:15.935337 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f969c670-a121-4c72-b46d-9f1b13603782 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:15.935789 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f969c670-a121-4c72-b46d-9f1b13603782 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:15.936208 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f969c670-a121-4c72-b46d-9f1b13603782 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:16.123430 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8f335e02-002f-4189-a3e8-7ebf426dd70c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:16.143190 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8f335e02-002f-4189-a3e8-7ebf426dd70c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1371 microversion: 2.1 time: 1.065832 Sep 06 22:45:16.144254 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 173/351] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:15 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1371 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:16.181681 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=2 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:45:16.214052 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=6 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:45:16.428212 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-f969c670-a121-4c72-b46d-9f1b13603782 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:16.444534 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-f969c670-a121-4c72-b46d-9f1b13603782 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:16.449464 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-f969c670-a121-4c72-b46d-9f1b13603782 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:16.451445 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-f969c670-a121-4c72-b46d-9f1b13603782 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1739 microversion: 2.20 time: 0.547011 Sep 06 22:45:16.454487 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 179/352] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:15 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1739 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:45:16.924013 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a71ad192-890e-431b-ab75-2685c812665c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:16.924926 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a71ad192-890e-431b-ab75-2685c812665c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:16.927421 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=6 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:45:16.941991 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a71ad192-890e-431b-ab75-2685c812665c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:16.942206 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a71ad192-890e-431b-ab75-2685c812665c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:16.942699 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a71ad192-890e-431b-ab75-2685c812665c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:16.943412 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a71ad192-890e-431b-ab75-2685c812665c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:16.943891 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a71ad192-890e-431b-ab75-2685c812665c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:16.944341 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a71ad192-890e-431b-ab75-2685c812665c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:17.169109 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f147017e-b256-4df3-8a40-d596a5e71b23 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:17.169713 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-f147017e-b256-4df3-8a40-d596a5e71b23 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:17.176287 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:45:17.178531 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f147017e-b256-4df3-8a40-d596a5e71b23 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:17.180196 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f147017e-b256-4df3-8a40-d596a5e71b23 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:17.180196 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f147017e-b256-4df3-8a40-d596a5e71b23 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:17.180657 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f147017e-b256-4df3-8a40-d596a5e71b23 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:17.181277 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f147017e-b256-4df3-8a40-d596a5e71b23 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:17.181845 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f147017e-b256-4df3-8a40-d596a5e71b23 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:17.314660 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a71ad192-890e-431b-ab75-2685c812665c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:17.323831 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a71ad192-890e-431b-ab75-2685c812665c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1701 microversion: 2.1 time: 0.404160 Sep 06 22:45:17.324410 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 174/353] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:16 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1701 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:17.359842 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d8095486-be36-44c8-ae7b-dc71c9505a5d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:45:17.367203 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d8095486-be36-44c8-ae7b-dc71c9505a5d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:17.368709 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d8095486-be36-44c8-ae7b-dc71c9505a5d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:17.369315 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d8095486-be36-44c8-ae7b-dc71c9505a5d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:17.401410 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d8095486-be36-44c8-ae7b-dc71c9505a5d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Going to try to start instance {{(pid=127088) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 06 22:45:17.466190 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-f147017e-b256-4df3-8a40-d596a5e71b23 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:17.467676 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d8095486-be36-44c8-ae7b-dc71c9505a5d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "POST /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5/action" status: 202 len: 0 microversion: 2.1 time: 0.112428 Sep 06 22:45:17.469112 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 175/354] 10.222.0.39 () {60 vars in 1278 bytes} [Tue Sep 6 22:45:17 2022] POST /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 22:45:17.477556 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7033aaf4-e5fd-4ea2-9ae3-096827c20b5e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:17.478396 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-f147017e-b256-4df3-8a40-d596a5e71b23 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1371 microversion: 2.1 time: 0.313214 Sep 06 22:45:17.478637 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7033aaf4-e5fd-4ea2-9ae3-096827c20b5e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:17.478973 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 180/355] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:17 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1371 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:45:17.489229 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7033aaf4-e5fd-4ea2-9ae3-096827c20b5e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:17.490095 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7033aaf4-e5fd-4ea2-9ae3-096827c20b5e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:17.490686 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7033aaf4-e5fd-4ea2-9ae3-096827c20b5e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:17.491553 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7033aaf4-e5fd-4ea2-9ae3-096827c20b5e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:17.492152 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7033aaf4-e5fd-4ea2-9ae3-096827c20b5e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:17.492731 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7033aaf4-e5fd-4ea2-9ae3-096827c20b5e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:17.500662 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-1973505b-11d2-4df8-b2b6-f838186101d5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:17.503284 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-1973505b-11d2-4df8-b2b6-f838186101d5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:17.526571 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1973505b-11d2-4df8-b2b6-f838186101d5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:17.532091 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1973505b-11d2-4df8-b2b6-f838186101d5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:17.535539 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1973505b-11d2-4df8-b2b6-f838186101d5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:17.536568 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1973505b-11d2-4df8-b2b6-f838186101d5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:17.540043 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1973505b-11d2-4df8-b2b6-f838186101d5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:17.540729 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1973505b-11d2-4df8-b2b6-f838186101d5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:17.849076 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7033aaf4-e5fd-4ea2-9ae3-096827c20b5e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:17.866628 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7033aaf4-e5fd-4ea2-9ae3-096827c20b5e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1710 microversion: 2.1 time: 0.393335 Sep 06 22:45:17.867572 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 176/356] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:17 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1710 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:45:17.905316 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-1973505b-11d2-4df8-b2b6-f838186101d5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:17.918407 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-1973505b-11d2-4df8-b2b6-f838186101d5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:17.926471 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-1973505b-11d2-4df8-b2b6-f838186101d5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:17.928560 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-1973505b-11d2-4df8-b2b6-f838186101d5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1739 microversion: 2.20 time: 0.443171 Sep 06 22:45:17.929264 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 181/357] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:17 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1739 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:45:18.506181 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-63145ccd-8a3c-458d-be95-f3f65fa342d2 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:18.506810 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-63145ccd-8a3c-458d-be95-f3f65fa342d2 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:18.523830 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-63145ccd-8a3c-458d-be95-f3f65fa342d2 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:18.524676 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-63145ccd-8a3c-458d-be95-f3f65fa342d2 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:18.525326 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-63145ccd-8a3c-458d-be95-f3f65fa342d2 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:18.526279 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-63145ccd-8a3c-458d-be95-f3f65fa342d2 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:18.526770 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-63145ccd-8a3c-458d-be95-f3f65fa342d2 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:18.527202 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-63145ccd-8a3c-458d-be95-f3f65fa342d2 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:18.884125 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-63145ccd-8a3c-458d-be95-f3f65fa342d2 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:18.896034 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-3c0ccc29-e675-4a08-a24a-f460827a7d43 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:18.897519 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-3c0ccc29-e675-4a08-a24a-f460827a7d43 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:18.906545 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-63145ccd-8a3c-458d-be95-f3f65fa342d2 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1371 microversion: 2.1 time: 0.403798 Sep 06 22:45:18.931165 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 177/358] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:18 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1371 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:18.931284 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3c0ccc29-e675-4a08-a24a-f460827a7d43 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:18.931284 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3c0ccc29-e675-4a08-a24a-f460827a7d43 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:18.931284 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3c0ccc29-e675-4a08-a24a-f460827a7d43 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:18.931284 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3c0ccc29-e675-4a08-a24a-f460827a7d43 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:18.939340 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3c0ccc29-e675-4a08-a24a-f460827a7d43 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:18.957894 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3c0ccc29-e675-4a08-a24a-f460827a7d43 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:18.981404 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7a76aa85-536f-4d0f-aba1-dc461a510178 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:18.982015 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7a76aa85-536f-4d0f-aba1-dc461a510178 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:19.008282 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a76aa85-536f-4d0f-aba1-dc461a510178 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:19.008918 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a76aa85-536f-4d0f-aba1-dc461a510178 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:19.009245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a76aa85-536f-4d0f-aba1-dc461a510178 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:19.009966 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a76aa85-536f-4d0f-aba1-dc461a510178 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:19.010416 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a76aa85-536f-4d0f-aba1-dc461a510178 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:19.010841 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7a76aa85-536f-4d0f-aba1-dc461a510178 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:19.378315 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3c0ccc29-e675-4a08-a24a-f460827a7d43 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:19.409570 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-3c0ccc29-e675-4a08-a24a-f460827a7d43 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1710 microversion: 2.1 time: 0.517504 Sep 06 22:45:19.412554 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 182/359] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:18 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1710 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:45:19.524882 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7a76aa85-536f-4d0f-aba1-dc461a510178 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:19.538198 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7a76aa85-536f-4d0f-aba1-dc461a510178 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:19.541292 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7a76aa85-536f-4d0f-aba1-dc461a510178 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:19.561627 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7a76aa85-536f-4d0f-aba1-dc461a510178 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1739 microversion: 2.20 time: 0.597319 Sep 06 22:45:19.564046 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 178/360] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:18 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1739 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:45:19.937733 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-046cc6fa-2f1f-459b-b1e0-0190adedd56e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:19.939103 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-046cc6fa-2f1f-459b-b1e0-0190adedd56e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:19.946717 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-046cc6fa-2f1f-459b-b1e0-0190adedd56e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:19.947598 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-046cc6fa-2f1f-459b-b1e0-0190adedd56e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:19.948247 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-046cc6fa-2f1f-459b-b1e0-0190adedd56e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:19.949356 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-046cc6fa-2f1f-459b-b1e0-0190adedd56e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:19.950028 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-046cc6fa-2f1f-459b-b1e0-0190adedd56e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:19.952238 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-046cc6fa-2f1f-459b-b1e0-0190adedd56e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:19.982619 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=100 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:45:20.440481 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-273e74e0-49f2-4cdb-802a-6dfa690e287f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:20.441294 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-273e74e0-49f2-4cdb-802a-6dfa690e287f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:20.449098 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-273e74e0-49f2-4cdb-802a-6dfa690e287f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:20.451135 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-273e74e0-49f2-4cdb-802a-6dfa690e287f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:20.452434 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-273e74e0-49f2-4cdb-802a-6dfa690e287f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:20.456700 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-273e74e0-49f2-4cdb-802a-6dfa690e287f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:20.457443 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-273e74e0-49f2-4cdb-802a-6dfa690e287f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:20.459154 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-273e74e0-49f2-4cdb-802a-6dfa690e287f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:20.504417 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-046cc6fa-2f1f-459b-b1e0-0190adedd56e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:20.515056 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-046cc6fa-2f1f-459b-b1e0-0190adedd56e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1371 microversion: 2.1 time: 0.583087 Sep 06 22:45:20.533349 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 183/361] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:19 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1371 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:20.595913 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-c69030ef-ffe5-4fa9-99ef-ae9e6b196e01 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:20.596787 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-c69030ef-ffe5-4fa9-99ef-ae9e6b196e01 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:20.603118 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c69030ef-ffe5-4fa9-99ef-ae9e6b196e01 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:20.603597 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c69030ef-ffe5-4fa9-99ef-ae9e6b196e01 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:20.604021 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c69030ef-ffe5-4fa9-99ef-ae9e6b196e01 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:20.604964 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c69030ef-ffe5-4fa9-99ef-ae9e6b196e01 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:20.605415 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c69030ef-ffe5-4fa9-99ef-ae9e6b196e01 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:20.605997 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c69030ef-ffe5-4fa9-99ef-ae9e6b196e01 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:20.837409 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-273e74e0-49f2-4cdb-802a-6dfa690e287f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:20.849145 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-273e74e0-49f2-4cdb-802a-6dfa690e287f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1710 microversion: 2.1 time: 0.412357 Sep 06 22:45:20.859528 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 179/362] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:20 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1710 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:20.884304 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-c69030ef-ffe5-4fa9-99ef-ae9e6b196e01 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:20.892992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-c69030ef-ffe5-4fa9-99ef-ae9e6b196e01 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:20.894518 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-c69030ef-ffe5-4fa9-99ef-ae9e6b196e01 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:20.895657 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-c69030ef-ffe5-4fa9-99ef-ae9e6b196e01 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1739 microversion: 2.20 time: 0.306568 Sep 06 22:45:20.896463 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 184/363] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:20 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1739 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:45:21.553619 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fd39d32f-a440-4897-bd1b-3ade9ade2286 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:21.554670 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fd39d32f-a440-4897-bd1b-3ade9ade2286 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:21.561399 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fd39d32f-a440-4897-bd1b-3ade9ade2286 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:21.562009 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fd39d32f-a440-4897-bd1b-3ade9ade2286 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:21.562523 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fd39d32f-a440-4897-bd1b-3ade9ade2286 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:21.563315 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fd39d32f-a440-4897-bd1b-3ade9ade2286 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:21.563964 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fd39d32f-a440-4897-bd1b-3ade9ade2286 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:21.564469 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fd39d32f-a440-4897-bd1b-3ade9ade2286 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:21.748739 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fd39d32f-a440-4897-bd1b-3ade9ade2286 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:21.759612 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fd39d32f-a440-4897-bd1b-3ade9ade2286 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1371 microversion: 2.1 time: 0.209770 Sep 06 22:45:21.760327 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 180/364] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:21 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:21.874062 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-0035da08-b413-4412-979f-d48ec49c3d66 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:21.874713 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-0035da08-b413-4412-979f-d48ec49c3d66 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:21.881720 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0035da08-b413-4412-979f-d48ec49c3d66 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:21.882560 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0035da08-b413-4412-979f-d48ec49c3d66 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:21.883325 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0035da08-b413-4412-979f-d48ec49c3d66 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:21.884223 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0035da08-b413-4412-979f-d48ec49c3d66 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:21.884733 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0035da08-b413-4412-979f-d48ec49c3d66 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:21.885565 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0035da08-b413-4412-979f-d48ec49c3d66 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:21.926586 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d5ff9422-2177-43d6-948a-0593325849e1 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:21.927380 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d5ff9422-2177-43d6-948a-0593325849e1 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:21.942771 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d5ff9422-2177-43d6-948a-0593325849e1 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:21.943519 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d5ff9422-2177-43d6-948a-0593325849e1 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:21.944178 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d5ff9422-2177-43d6-948a-0593325849e1 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:21.945715 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d5ff9422-2177-43d6-948a-0593325849e1 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:21.947228 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d5ff9422-2177-43d6-948a-0593325849e1 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:21.948547 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d5ff9422-2177-43d6-948a-0593325849e1 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:22.163099 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-0035da08-b413-4412-979f-d48ec49c3d66 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:22.179110 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-0035da08-b413-4412-979f-d48ec49c3d66 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1710 microversion: 2.1 time: 0.309104 Sep 06 22:45:22.179679 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 185/365] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:21 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1710 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:22.215668 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d5ff9422-2177-43d6-948a-0593325849e1 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:22.229914 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d5ff9422-2177-43d6-948a-0593325849e1 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:22.231656 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d5ff9422-2177-43d6-948a-0593325849e1 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:22.233201 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d5ff9422-2177-43d6-948a-0593325849e1 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1739 microversion: 2.20 time: 0.314036 Sep 06 22:45:22.234639 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 181/366] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:21 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1739 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:45:22.783339 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-0abb28f2-886a-4587-829f-cf4043b8d7cb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:22.784245 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-0abb28f2-886a-4587-829f-cf4043b8d7cb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:22.790698 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0abb28f2-886a-4587-829f-cf4043b8d7cb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:22.791286 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0abb28f2-886a-4587-829f-cf4043b8d7cb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:22.791816 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0abb28f2-886a-4587-829f-cf4043b8d7cb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:22.792838 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0abb28f2-886a-4587-829f-cf4043b8d7cb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:22.793522 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0abb28f2-886a-4587-829f-cf4043b8d7cb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:22.794026 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0abb28f2-886a-4587-829f-cf4043b8d7cb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:22.999097 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-0abb28f2-886a-4587-829f-cf4043b8d7cb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:23.009560 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-0abb28f2-886a-4587-829f-cf4043b8d7cb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1371 microversion: 2.1 time: 0.230658 Sep 06 22:45:23.025340 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 186/367] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:22 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1371 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:23.205805 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2bde9448-9b8a-4906-9a60-0c8e9208206b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:23.206854 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2bde9448-9b8a-4906-9a60-0c8e9208206b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:23.213481 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2bde9448-9b8a-4906-9a60-0c8e9208206b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:23.219877 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2bde9448-9b8a-4906-9a60-0c8e9208206b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:23.221303 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2bde9448-9b8a-4906-9a60-0c8e9208206b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:23.222290 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2bde9448-9b8a-4906-9a60-0c8e9208206b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:23.224248 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2bde9448-9b8a-4906-9a60-0c8e9208206b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:23.225115 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2bde9448-9b8a-4906-9a60-0c8e9208206b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:23.278430 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-bd62b05e-2ed1-46c0-9319-cc5f57e29b30 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:23.279392 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-bd62b05e-2ed1-46c0-9319-cc5f57e29b30 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:23.288017 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd62b05e-2ed1-46c0-9319-cc5f57e29b30 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:23.294281 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd62b05e-2ed1-46c0-9319-cc5f57e29b30 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:23.297630 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd62b05e-2ed1-46c0-9319-cc5f57e29b30 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:23.298853 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd62b05e-2ed1-46c0-9319-cc5f57e29b30 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:23.299255 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd62b05e-2ed1-46c0-9319-cc5f57e29b30 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:23.299770 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd62b05e-2ed1-46c0-9319-cc5f57e29b30 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:23.553587 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2bde9448-9b8a-4906-9a60-0c8e9208206b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:23.568832 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2bde9448-9b8a-4906-9a60-0c8e9208206b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1710 microversion: 2.1 time: 0.368795 Sep 06 22:45:23.570393 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 182/368] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:23 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1710 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:23.581788 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-bd62b05e-2ed1-46c0-9319-cc5f57e29b30 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:23.591936 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-bd62b05e-2ed1-46c0-9319-cc5f57e29b30 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:23.594223 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-bd62b05e-2ed1-46c0-9319-cc5f57e29b30 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:23.595450 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-bd62b05e-2ed1-46c0-9319-cc5f57e29b30 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1739 microversion: 2.20 time: 0.338525 Sep 06 22:45:23.596006 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 187/369] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:23 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1739 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:45:24.038175 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-92e8f3e6-a648-49e8-817b-105ac9658132 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:24.038797 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-92e8f3e6-a648-49e8-817b-105ac9658132 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:24.045752 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92e8f3e6-a648-49e8-817b-105ac9658132 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:24.046798 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92e8f3e6-a648-49e8-817b-105ac9658132 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:24.047973 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92e8f3e6-a648-49e8-817b-105ac9658132 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:24.049013 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92e8f3e6-a648-49e8-817b-105ac9658132 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:24.049684 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92e8f3e6-a648-49e8-817b-105ac9658132 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:24.050264 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92e8f3e6-a648-49e8-817b-105ac9658132 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:24.285394 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-92e8f3e6-a648-49e8-817b-105ac9658132 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:24.293796 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-92e8f3e6-a648-49e8-817b-105ac9658132 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1371 microversion: 2.1 time: 0.263443 Sep 06 22:45:24.294732 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 183/370] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:24 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1371 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:24.593612 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-99506c01-1970-49d0-be9c-a83ccb58792c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:24.594879 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-99506c01-1970-49d0-be9c-a83ccb58792c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:24.601750 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-99506c01-1970-49d0-be9c-a83ccb58792c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:24.602790 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-99506c01-1970-49d0-be9c-a83ccb58792c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:24.603410 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-99506c01-1970-49d0-be9c-a83ccb58792c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:24.604342 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-99506c01-1970-49d0-be9c-a83ccb58792c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:24.605021 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-99506c01-1970-49d0-be9c-a83ccb58792c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:24.606058 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-99506c01-1970-49d0-be9c-a83ccb58792c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:24.627681 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2e9b033c-4ed2-48b0-b771-c3be4401e50c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:24.629868 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2e9b033c-4ed2-48b0-b771-c3be4401e50c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:24.636798 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e9b033c-4ed2-48b0-b771-c3be4401e50c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:24.637441 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e9b033c-4ed2-48b0-b771-c3be4401e50c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:24.638522 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e9b033c-4ed2-48b0-b771-c3be4401e50c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:24.639470 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e9b033c-4ed2-48b0-b771-c3be4401e50c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:24.641089 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e9b033c-4ed2-48b0-b771-c3be4401e50c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:24.642416 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e9b033c-4ed2-48b0-b771-c3be4401e50c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:24.667666 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:45:24.930963 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-99506c01-1970-49d0-be9c-a83ccb58792c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:24.941252 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2e9b033c-4ed2-48b0-b771-c3be4401e50c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:24.942364 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-99506c01-1970-49d0-be9c-a83ccb58792c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1710 microversion: 2.1 time: 0.352487 Sep 06 22:45:24.949893 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2e9b033c-4ed2-48b0-b771-c3be4401e50c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:24.951556 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2e9b033c-4ed2-48b0-b771-c3be4401e50c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:24.953422 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2e9b033c-4ed2-48b0-b771-c3be4401e50c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1739 microversion: 2.20 time: 0.334765 Sep 06 22:45:24.972990 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 188/371] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:24 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1710 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:24.973954 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 184/372] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:24 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1739 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:45:25.318822 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-c93c59b1-efe8-411d-87f8-1f39b4db98cb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:25.319435 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-c93c59b1-efe8-411d-87f8-1f39b4db98cb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:25.332415 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c93c59b1-efe8-411d-87f8-1f39b4db98cb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:25.332942 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c93c59b1-efe8-411d-87f8-1f39b4db98cb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:25.333374 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c93c59b1-efe8-411d-87f8-1f39b4db98cb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:25.334072 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c93c59b1-efe8-411d-87f8-1f39b4db98cb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:25.334820 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c93c59b1-efe8-411d-87f8-1f39b4db98cb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:25.335415 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c93c59b1-efe8-411d-87f8-1f39b4db98cb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:25.972494 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b7dad142-d383-4280-82e2-c5b609b2de55 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:25.974901 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b7dad142-d383-4280-82e2-c5b609b2de55 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:25.988843 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b7dad142-d383-4280-82e2-c5b609b2de55 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:25.989441 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b7dad142-d383-4280-82e2-c5b609b2de55 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:25.989873 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b7dad142-d383-4280-82e2-c5b609b2de55 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:25.990728 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b7dad142-d383-4280-82e2-c5b609b2de55 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:25.991618 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b7dad142-d383-4280-82e2-c5b609b2de55 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:25.992372 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b7dad142-d383-4280-82e2-c5b609b2de55 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:26.036589 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-c93c59b1-efe8-411d-87f8-1f39b4db98cb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:26.051034 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-c93c59b1-efe8-411d-87f8-1f39b4db98cb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1371 microversion: 2.1 time: 0.730153 Sep 06 22:45:26.051034 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 189/373] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:25 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1371 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:26.065937 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-cb0b8eff-6d1f-4373-94b4-d9ce75781eaf tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:26.066969 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-cb0b8eff-6d1f-4373-94b4-d9ce75781eaf tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:26.073930 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cb0b8eff-6d1f-4373-94b4-d9ce75781eaf tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:26.074493 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cb0b8eff-6d1f-4373-94b4-d9ce75781eaf tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:26.074989 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cb0b8eff-6d1f-4373-94b4-d9ce75781eaf tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:26.075843 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cb0b8eff-6d1f-4373-94b4-d9ce75781eaf tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:26.076354 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cb0b8eff-6d1f-4373-94b4-d9ce75781eaf tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:26.076861 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cb0b8eff-6d1f-4373-94b4-d9ce75781eaf tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:26.516004 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b7dad142-d383-4280-82e2-c5b609b2de55 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:26.527289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b7dad142-d383-4280-82e2-c5b609b2de55 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1710 microversion: 2.1 time: 0.563675 Sep 06 22:45:26.530059 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 185/374] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:25 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1710 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:26.607587 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-cb0b8eff-6d1f-4373-94b4-d9ce75781eaf tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:26.617682 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-cb0b8eff-6d1f-4373-94b4-d9ce75781eaf tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:26.619135 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-cb0b8eff-6d1f-4373-94b4-d9ce75781eaf tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:26.620294 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-cb0b8eff-6d1f-4373-94b4-d9ce75781eaf tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1721 microversion: 2.20 time: 0.565390 Sep 06 22:45:26.634114 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 190/375] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:26 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1721 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:45:27.078537 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0cd93cfd-f08f-4f07-9d82-9d5d6081bae8 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:27.081215 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0cd93cfd-f08f-4f07-9d82-9d5d6081bae8 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:27.109506 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0cd93cfd-f08f-4f07-9d82-9d5d6081bae8 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:27.110974 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0cd93cfd-f08f-4f07-9d82-9d5d6081bae8 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:27.113585 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0cd93cfd-f08f-4f07-9d82-9d5d6081bae8 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:27.118702 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0cd93cfd-f08f-4f07-9d82-9d5d6081bae8 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:27.119459 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0cd93cfd-f08f-4f07-9d82-9d5d6081bae8 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:27.120136 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0cd93cfd-f08f-4f07-9d82-9d5d6081bae8 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:27.477305 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0cd93cfd-f08f-4f07-9d82-9d5d6081bae8 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:27.488019 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0cd93cfd-f08f-4f07-9d82-9d5d6081bae8 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1371 microversion: 2.1 time: 0.420223 Sep 06 22:45:27.501137 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 186/376] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:27 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1371 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:27.554811 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ad9d4779-1a1c-40b0-9215-eac38be8e97b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:27.556173 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ad9d4779-1a1c-40b0-9215-eac38be8e97b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:27.564098 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ad9d4779-1a1c-40b0-9215-eac38be8e97b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:27.564994 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ad9d4779-1a1c-40b0-9215-eac38be8e97b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:27.565628 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ad9d4779-1a1c-40b0-9215-eac38be8e97b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:27.566482 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ad9d4779-1a1c-40b0-9215-eac38be8e97b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:27.566935 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ad9d4779-1a1c-40b0-9215-eac38be8e97b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:27.567456 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ad9d4779-1a1c-40b0-9215-eac38be8e97b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:27.711771 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ad9d4779-1a1c-40b0-9215-eac38be8e97b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:27.720873 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ad9d4779-1a1c-40b0-9215-eac38be8e97b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1710 microversion: 2.1 time: 0.170326 Sep 06 22:45:27.721457 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 191/377] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:27 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1710 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:27.746680 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-c2e269c3-d9c1-4ab0-8731-b416cb68abf3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:27.747286 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-c2e269c3-d9c1-4ab0-8731-b416cb68abf3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:27.754136 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c2e269c3-d9c1-4ab0-8731-b416cb68abf3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:27.754615 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c2e269c3-d9c1-4ab0-8731-b416cb68abf3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:27.755039 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c2e269c3-d9c1-4ab0-8731-b416cb68abf3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:27.755888 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c2e269c3-d9c1-4ab0-8731-b416cb68abf3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:27.756493 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c2e269c3-d9c1-4ab0-8731-b416cb68abf3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:27.757098 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c2e269c3-d9c1-4ab0-8731-b416cb68abf3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:27.809255 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3df80d1b-82d9-48c5-be9d-61bfc653bf0e tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Action: 'create', calling method: .version_select at 0x7f9c4f80d670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1102918603", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORpGI4hCIj9K4mI6bascL2ymqP4//s7CdiAjsPbofWkcZYB4LRL79yp1R5JyO/ADsTLP8a6IxlcZPkleriPjpZo2XJuEYQrmFvszWCm3lmDRQZZvhkROOgzo6nwWwmzqg=="}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:45:27.824972 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-3df80d1b-82d9-48c5-be9d-61bfc653bf0e tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Getting quotas for project cc47231427ec4337833eb5d733b211bc. Resources: {'key_pairs'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 22:45:27.830189 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-3df80d1b-82d9-48c5-be9d-61bfc653bf0e tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Getting quotas for user 29018ec15cc147d3919d9047569a4c68 and project cc47231427ec4337833eb5d733b211bc. Resources: {'key_pairs'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 22:45:27.860298 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3df80d1b-82d9-48c5-be9d-61bfc653bf0e tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.230973 Sep 06 22:45:27.861022 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 187/378] 10.222.0.39 () {60 vars in 1159 bytes} [Tue Sep 6 22:45:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 22:45:27.914697 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-c2e269c3-d9c1-4ab0-8731-b416cb68abf3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:27.928312 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-c2e269c3-d9c1-4ab0-8731-b416cb68abf3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:27.930089 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-c2e269c3-d9c1-4ab0-8731-b416cb68abf3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:27.931480 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-c2e269c3-d9c1-4ab0-8731-b416cb68abf3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1721 microversion: 2.20 time: 0.188447 Sep 06 22:45:27.944165 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 192/379] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:27 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1721 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:45:28.307706 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-15601b83-495d-4e48-9953-f0f1aa2f9c0c tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:28.308270 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-15601b83-495d-4e48-9953-f0f1aa2f9c0c tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c9f58e44-e53c-4224-9b62-a3c23ba54ade] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:28.315553 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-15601b83-495d-4e48-9953-f0f1aa2f9c0c tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:28.316165 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-15601b83-495d-4e48-9953-f0f1aa2f9c0c tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:28.316658 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-15601b83-495d-4e48-9953-f0f1aa2f9c0c tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:28.318005 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-15601b83-495d-4e48-9953-f0f1aa2f9c0c tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:28.318491 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-15601b83-495d-4e48-9953-f0f1aa2f9c0c tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:28.318935 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-15601b83-495d-4e48-9953-f0f1aa2f9c0c tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:28.474879 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-15601b83-495d-4e48-9953-f0f1aa2f9c0c tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lazy-loading 'services' on Instance uuid c9f58e44-e53c-4224-9b62-a3c23ba54ade {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 22:45:28.512940 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-312a2eb6-9e92-4d52-ae25-fad2f2bab981 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:28.513552 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-312a2eb6-9e92-4d52-ae25-fad2f2bab981 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:28.523100 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-312a2eb6-9e92-4d52-ae25-fad2f2bab981 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:28.523597 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-312a2eb6-9e92-4d52-ae25-fad2f2bab981 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:28.524207 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-312a2eb6-9e92-4d52-ae25-fad2f2bab981 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:28.525124 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-312a2eb6-9e92-4d52-ae25-fad2f2bab981 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:28.525898 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-312a2eb6-9e92-4d52-ae25-fad2f2bab981 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:28.526475 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-312a2eb6-9e92-4d52-ae25-fad2f2bab981 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:28.630341 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-15601b83-495d-4e48-9953-f0f1aa2f9c0c tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade/os-volume_attachments/54410b9b-3862-4930-bce8-fba080be2ff5" status: 202 len: 0 microversion: 2.1 time: 0.327948 Sep 06 22:45:28.633632 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 188/380] 10.222.0.39 () {58 vars in 1416 bytes} [Tue Sep 6 22:45:28 2022] DELETE /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade/os-volume_attachments/54410b9b-3862-4930-bce8-fba080be2ff5 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 22:45:28.650164 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-974ff69f-49cc-4724-8830-daeefc06eddf req-054a56c4-3dc9-4701-937c-a4647d32f448 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b07b208-45e2-45aa-ad7b-bede527cfb6d", "name": "network-vif-plugged", "status": "completed", "tag": "bc5d6b1f-b033-4efc-ac9f-ff0f920a565c"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:45:28.663711 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-974ff69f-49cc-4724-8830-daeefc06eddf req-054a56c4-3dc9-4701-937c-a4647d32f448 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:28.664252 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-974ff69f-49cc-4724-8830-daeefc06eddf req-054a56c4-3dc9-4701-937c-a4647d32f448 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:28.664700 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-974ff69f-49cc-4724-8830-daeefc06eddf req-054a56c4-3dc9-4701-937c-a4647d32f448 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:28.679615 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-974ff69f-49cc-4724-8830-daeefc06eddf req-054a56c4-3dc9-4701-937c-a4647d32f448 service nova] Creating event network-vif-plugged:bc5d6b1f-b033-4efc-ac9f-ff0f920a565c for instance 7b07b208-45e2-45aa-ad7b-bede527cfb6d on hv-cinder-85220 Sep 06 22:45:28.688117 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-974ff69f-49cc-4724-8830-daeefc06eddf req-054a56c4-3dc9-4701-937c-a4647d32f448 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045230 Sep 06 22:45:28.689764 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 189/381] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:45:28.745568 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9edd9346-2ba9-41a1-81e2-6d02b145ef5d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:28.746518 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9edd9346-2ba9-41a1-81e2-6d02b145ef5d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:28.762927 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9edd9346-2ba9-41a1-81e2-6d02b145ef5d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:28.763703 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9edd9346-2ba9-41a1-81e2-6d02b145ef5d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:28.764389 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9edd9346-2ba9-41a1-81e2-6d02b145ef5d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:28.766336 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-312a2eb6-9e92-4d52-ae25-fad2f2bab981 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:28.766817 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9edd9346-2ba9-41a1-81e2-6d02b145ef5d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:28.766969 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9edd9346-2ba9-41a1-81e2-6d02b145ef5d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:28.767874 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9edd9346-2ba9-41a1-81e2-6d02b145ef5d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:28.783380 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-312a2eb6-9e92-4d52-ae25-fad2f2bab981 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1371 microversion: 2.1 time: 0.274467 Sep 06 22:45:28.784012 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 193/382] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:28 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1371 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:45:28.930683 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9edd9346-2ba9-41a1-81e2-6d02b145ef5d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:28.940744 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9edd9346-2ba9-41a1-81e2-6d02b145ef5d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1714 microversion: 2.1 time: 0.199987 Sep 06 22:45:28.941670 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 190/383] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:28 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1714 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:45:28.960119 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e5ec5504-5abe-4fd7-9e5a-d56c5cb328a9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:28.960936 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e5ec5504-5abe-4fd7-9e5a-d56c5cb328a9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:28.966773 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e5ec5504-5abe-4fd7-9e5a-d56c5cb328a9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:28.967442 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e5ec5504-5abe-4fd7-9e5a-d56c5cb328a9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:28.967867 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e5ec5504-5abe-4fd7-9e5a-d56c5cb328a9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:28.968649 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e5ec5504-5abe-4fd7-9e5a-d56c5cb328a9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:28.969211 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e5ec5504-5abe-4fd7-9e5a-d56c5cb328a9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:28.969720 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e5ec5504-5abe-4fd7-9e5a-d56c5cb328a9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:29.169517 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e5ec5504-5abe-4fd7-9e5a-d56c5cb328a9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:29.181597 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e5ec5504-5abe-4fd7-9e5a-d56c5cb328a9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:29.183069 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e5ec5504-5abe-4fd7-9e5a-d56c5cb328a9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:29.187592 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e5ec5504-5abe-4fd7-9e5a-d56c5cb328a9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1721 microversion: 2.20 time: 0.228104 Sep 06 22:45:29.187592 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 194/384] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:28 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1721 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:45:29.807758 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-22554d58-5d0a-4577-83d4-8ebb9ecdaa50 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:29.809184 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-22554d58-5d0a-4577-83d4-8ebb9ecdaa50 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:29.818235 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-22554d58-5d0a-4577-83d4-8ebb9ecdaa50 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:29.818854 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-22554d58-5d0a-4577-83d4-8ebb9ecdaa50 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:29.819707 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-22554d58-5d0a-4577-83d4-8ebb9ecdaa50 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:29.820221 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-22554d58-5d0a-4577-83d4-8ebb9ecdaa50 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:29.820732 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-22554d58-5d0a-4577-83d4-8ebb9ecdaa50 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:29.821304 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-22554d58-5d0a-4577-83d4-8ebb9ecdaa50 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:29.961976 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-22554d58-5d0a-4577-83d4-8ebb9ecdaa50 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:29.970710 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-22554d58-5d0a-4577-83d4-8ebb9ecdaa50 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1371 microversion: 2.1 time: 0.167742 Sep 06 22:45:29.971290 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 191/385] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:29 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:30.210150 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-8608f1dc-0a2a-4e77-ab5b-4adf764846c7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:30.210778 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-8608f1dc-0a2a-4e77-ab5b-4adf764846c7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:30.216901 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8608f1dc-0a2a-4e77-ab5b-4adf764846c7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:30.217390 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8608f1dc-0a2a-4e77-ab5b-4adf764846c7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:30.217817 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8608f1dc-0a2a-4e77-ab5b-4adf764846c7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:30.219832 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8608f1dc-0a2a-4e77-ab5b-4adf764846c7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:30.220288 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8608f1dc-0a2a-4e77-ab5b-4adf764846c7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:30.220710 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8608f1dc-0a2a-4e77-ab5b-4adf764846c7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:30.356739 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-8608f1dc-0a2a-4e77-ab5b-4adf764846c7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:30.365690 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-8608f1dc-0a2a-4e77-ab5b-4adf764846c7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:30.367131 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-8608f1dc-0a2a-4e77-ab5b-4adf764846c7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:30.368261 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-8608f1dc-0a2a-4e77-ab5b-4adf764846c7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1724 microversion: 2.20 time: 0.162086 Sep 06 22:45:30.368864 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 195/386] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:30 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:45:30.393538 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bb3e6c77-d774-41b6-ac28-712af0a40808 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2193943-2848-49ef-a0ca-fe997883994e"}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:45:30.396346 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bb3e6c77-d774-41b6-ac28-712af0a40808 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:30.402428 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bb3e6c77-d774-41b6-ac28-712af0a40808 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:30.402920 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bb3e6c77-d774-41b6-ac28-712af0a40808 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:30.403355 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bb3e6c77-d774-41b6-ac28-712af0a40808 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:30.404051 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bb3e6c77-d774-41b6-ac28-712af0a40808 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:30.404503 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bb3e6c77-d774-41b6-ac28-712af0a40808 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:30.404965 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bb3e6c77-d774-41b6-ac28-712af0a40808 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:30.701291 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bb3e6c77-d774-41b6-ac28-712af0a40808 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "POST /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.311767 Sep 06 22:45:30.708075 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 192/387] 10.222.0.39 () {62 vars in 1364 bytes} [Tue Sep 6 22:45:30 2022] POST /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd/os-volume_attachments => generated 188 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 22:45:30.711505 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-3aed56f7-ef49-4ab7-8823-a2d4d5507308 req-7652ec3a-4ee9-436e-aaf3-4f411055c8e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13ef5db2-b5d1-41af-8c93-2851abb0b6dd", "name": "network-vif-unplugged", "status": "completed", "tag": "2130f481-0970-42ca-bbc5-20da06de6a04"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:45:30.722694 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-3aed56f7-ef49-4ab7-8823-a2d4d5507308 req-7652ec3a-4ee9-436e-aaf3-4f411055c8e9 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:30.723650 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-3aed56f7-ef49-4ab7-8823-a2d4d5507308 req-7652ec3a-4ee9-436e-aaf3-4f411055c8e9 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:30.724340 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-3aed56f7-ef49-4ab7-8823-a2d4d5507308 req-7652ec3a-4ee9-436e-aaf3-4f411055c8e9 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:30.738766 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-3aed56f7-ef49-4ab7-8823-a2d4d5507308 req-7652ec3a-4ee9-436e-aaf3-4f411055c8e9 service nova] Creating event network-vif-unplugged:2130f481-0970-42ca-bbc5-20da06de6a04 for instance 13ef5db2-b5d1-41af-8c93-2851abb0b6dd on hv-cinder-85220 Sep 06 22:45:30.752026 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-3aed56f7-ef49-4ab7-8823-a2d4d5507308 req-7652ec3a-4ee9-436e-aaf3-4f411055c8e9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044664 Sep 06 22:45:30.752633 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 196/388] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 22:45:30.853051 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ac3107ef-ef56-40e9-ad7a-9b8ea6e47a92 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:45:30.853836 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ac3107ef-ef56-40e9-ad7a-9b8ea6e47a92 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:30.862110 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac3107ef-ef56-40e9-ad7a-9b8ea6e47a92 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:30.862395 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac3107ef-ef56-40e9-ad7a-9b8ea6e47a92 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:30.862837 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac3107ef-ef56-40e9-ad7a-9b8ea6e47a92 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:30.863802 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac3107ef-ef56-40e9-ad7a-9b8ea6e47a92 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:30.864086 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac3107ef-ef56-40e9-ad7a-9b8ea6e47a92 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:30.864505 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac3107ef-ef56-40e9-ad7a-9b8ea6e47a92 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:30.908419 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ac3107ef-ef56-40e9-ad7a-9b8ea6e47a92 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127088) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 06 22:45:30.993163 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ac3107ef-ef56-40e9-ad7a-9b8ea6e47a92 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "POST /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd/action" status: 202 len: 0 microversion: 2.20 time: 0.148969 Sep 06 22:45:30.995725 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 193/389] 10.222.0.39 () {62 vars in 1319 bytes} [Tue Sep 6 22:45:30 2022] POST /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 22:45:31.001901 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-349b8aa8-5d54-475c-97a7-79606338368c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:31.003359 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-349b8aa8-5d54-475c-97a7-79606338368c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:31.008262 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b041895c-cb29-46e1-9f23-0dd860adaca7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:31.011232 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b041895c-cb29-46e1-9f23-0dd860adaca7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:31.016364 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-349b8aa8-5d54-475c-97a7-79606338368c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:31.017564 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-349b8aa8-5d54-475c-97a7-79606338368c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:31.018330 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-349b8aa8-5d54-475c-97a7-79606338368c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:31.019212 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-349b8aa8-5d54-475c-97a7-79606338368c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:31.019814 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-349b8aa8-5d54-475c-97a7-79606338368c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:31.020417 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-349b8aa8-5d54-475c-97a7-79606338368c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:31.022922 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b041895c-cb29-46e1-9f23-0dd860adaca7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:31.025111 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b041895c-cb29-46e1-9f23-0dd860adaca7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:31.029110 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b041895c-cb29-46e1-9f23-0dd860adaca7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:31.030001 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b041895c-cb29-46e1-9f23-0dd860adaca7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:31.030598 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b041895c-cb29-46e1-9f23-0dd860adaca7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:31.031354 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b041895c-cb29-46e1-9f23-0dd860adaca7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:31.270189 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-349b8aa8-5d54-475c-97a7-79606338368c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:31.279650 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-349b8aa8-5d54-475c-97a7-79606338368c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1371 microversion: 2.1 time: 0.289026 Sep 06 22:45:31.280214 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 197/390] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:30 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1371 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:31.291143 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b041895c-cb29-46e1-9f23-0dd860adaca7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:31.300254 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b041895c-cb29-46e1-9f23-0dd860adaca7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:31.301714 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b041895c-cb29-46e1-9f23-0dd860adaca7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:31.303553 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b041895c-cb29-46e1-9f23-0dd860adaca7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1810 microversion: 2.20 time: 0.304673 Sep 06 22:45:31.304259 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 194/391] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:30 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1810 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:45:32.303694 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-5d5ba0e1-2dcb-41e3-ba4a-687d469b4d48 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:32.304225 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-5d5ba0e1-2dcb-41e3-ba4a-687d469b4d48 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:32.310190 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5d5ba0e1-2dcb-41e3-ba4a-687d469b4d48 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:32.310671 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5d5ba0e1-2dcb-41e3-ba4a-687d469b4d48 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:32.311097 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5d5ba0e1-2dcb-41e3-ba4a-687d469b4d48 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:32.311776 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5d5ba0e1-2dcb-41e3-ba4a-687d469b4d48 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:32.312458 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5d5ba0e1-2dcb-41e3-ba4a-687d469b4d48 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:32.312922 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5d5ba0e1-2dcb-41e3-ba4a-687d469b4d48 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:32.329943 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f246e280-b026-4e25-9428-fbecf2f1e830 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:32.330552 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f246e280-b026-4e25-9428-fbecf2f1e830 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:32.337425 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f246e280-b026-4e25-9428-fbecf2f1e830 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:32.337909 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f246e280-b026-4e25-9428-fbecf2f1e830 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:32.338335 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f246e280-b026-4e25-9428-fbecf2f1e830 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:32.339022 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f246e280-b026-4e25-9428-fbecf2f1e830 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:32.339461 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f246e280-b026-4e25-9428-fbecf2f1e830 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:32.339871 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f246e280-b026-4e25-9428-fbecf2f1e830 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:32.527351 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-5d5ba0e1-2dcb-41e3-ba4a-687d469b4d48 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:32.535568 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f246e280-b026-4e25-9428-fbecf2f1e830 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:32.535841 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-5d5ba0e1-2dcb-41e3-ba4a-687d469b4d48 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1371 microversion: 2.1 time: 0.236062 Sep 06 22:45:32.536583 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 198/392] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:32 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1371 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:32.545693 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f246e280-b026-4e25-9428-fbecf2f1e830 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:32.547525 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f246e280-b026-4e25-9428-fbecf2f1e830 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:32.557542 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f246e280-b026-4e25-9428-fbecf2f1e830 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1810 microversion: 2.20 time: 0.232116 Sep 06 22:45:32.558048 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 195/393] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:32 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1810 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 22:45:33.560871 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-c8ef0a0b-0fcd-4312-bcd5-7370073b0493 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:33.561499 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-c8ef0a0b-0fcd-4312-bcd5-7370073b0493 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:33.567959 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c8ef0a0b-0fcd-4312-bcd5-7370073b0493 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:33.568434 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c8ef0a0b-0fcd-4312-bcd5-7370073b0493 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:33.568962 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c8ef0a0b-0fcd-4312-bcd5-7370073b0493 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:33.569650 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c8ef0a0b-0fcd-4312-bcd5-7370073b0493 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:33.570096 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c8ef0a0b-0fcd-4312-bcd5-7370073b0493 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:33.570516 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c8ef0a0b-0fcd-4312-bcd5-7370073b0493 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:33.583437 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7066cf12-4a00-477a-9333-b84c827129a8 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:33.584267 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7066cf12-4a00-477a-9333-b84c827129a8 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:33.591276 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7066cf12-4a00-477a-9333-b84c827129a8 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:33.592173 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7066cf12-4a00-477a-9333-b84c827129a8 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:33.592730 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7066cf12-4a00-477a-9333-b84c827129a8 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:33.594313 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7066cf12-4a00-477a-9333-b84c827129a8 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:33.594830 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7066cf12-4a00-477a-9333-b84c827129a8 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:33.595484 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7066cf12-4a00-477a-9333-b84c827129a8 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:33.771446 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-c8ef0a0b-0fcd-4312-bcd5-7370073b0493 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:33.776300 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7066cf12-4a00-477a-9333-b84c827129a8 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:33.781514 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-c8ef0a0b-0fcd-4312-bcd5-7370073b0493 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1371 microversion: 2.1 time: 0.223683 Sep 06 22:45:33.782129 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 199/394] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:33 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1371 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:33.786076 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7066cf12-4a00-477a-9333-b84c827129a8 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:33.787529 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7066cf12-4a00-477a-9333-b84c827129a8 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:33.788677 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7066cf12-4a00-477a-9333-b84c827129a8 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1810 microversion: 2.20 time: 0.209295 Sep 06 22:45:33.789253 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 196/395] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:33 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1810 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:45:34.805567 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-8431993f-0fb9-4010-b4ab-30c30e1e896f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:34.806165 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-8431993f-0fb9-4010-b4ab-30c30e1e896f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:34.813038 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8431993f-0fb9-4010-b4ab-30c30e1e896f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:34.813714 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8431993f-0fb9-4010-b4ab-30c30e1e896f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:34.814150 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8431993f-0fb9-4010-b4ab-30c30e1e896f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:34.814846 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8431993f-0fb9-4010-b4ab-30c30e1e896f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:34.815295 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8431993f-0fb9-4010-b4ab-30c30e1e896f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:34.815740 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8431993f-0fb9-4010-b4ab-30c30e1e896f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:34.816307 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5981e15f-6f18-4abb-82ec-fd9a428e1e83 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:34.817166 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5981e15f-6f18-4abb-82ec-fd9a428e1e83 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:34.823608 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5981e15f-6f18-4abb-82ec-fd9a428e1e83 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:34.824076 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5981e15f-6f18-4abb-82ec-fd9a428e1e83 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:34.824506 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5981e15f-6f18-4abb-82ec-fd9a428e1e83 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:34.825211 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5981e15f-6f18-4abb-82ec-fd9a428e1e83 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:34.825659 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5981e15f-6f18-4abb-82ec-fd9a428e1e83 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:34.826073 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5981e15f-6f18-4abb-82ec-fd9a428e1e83 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:35.022117 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-8431993f-0fb9-4010-b4ab-30c30e1e896f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:35.024501 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=100 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:45:35.029279 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5981e15f-6f18-4abb-82ec-fd9a428e1e83 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:35.032517 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-8431993f-0fb9-4010-b4ab-30c30e1e896f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1371 microversion: 2.1 time: 0.230505 Sep 06 22:45:35.033390 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 200/396] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:34 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1371 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:35.039991 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5981e15f-6f18-4abb-82ec-fd9a428e1e83 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:35.041932 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5981e15f-6f18-4abb-82ec-fd9a428e1e83 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:35.044365 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5981e15f-6f18-4abb-82ec-fd9a428e1e83 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1810 microversion: 2.20 time: 0.231208 Sep 06 22:45:35.044365 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 197/397] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:34 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1810 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:45:36.056268 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-69ae3af4-8835-462f-a970-8a26c2af667c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:36.059405 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-69ae3af4-8835-462f-a970-8a26c2af667c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:36.065883 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-69ae3af4-8835-462f-a970-8a26c2af667c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:36.066341 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-69ae3af4-8835-462f-a970-8a26c2af667c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:36.066766 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-69ae3af4-8835-462f-a970-8a26c2af667c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:36.067451 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-69ae3af4-8835-462f-a970-8a26c2af667c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:36.067892 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-69ae3af4-8835-462f-a970-8a26c2af667c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:36.068303 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-69ae3af4-8835-462f-a970-8a26c2af667c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:36.075034 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b8bf696d-8b4b-4bb8-894d-2d54ef0162bd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:36.075820 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b8bf696d-8b4b-4bb8-894d-2d54ef0162bd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:36.082819 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b8bf696d-8b4b-4bb8-894d-2d54ef0162bd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:36.083386 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b8bf696d-8b4b-4bb8-894d-2d54ef0162bd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:36.083888 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b8bf696d-8b4b-4bb8-894d-2d54ef0162bd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:36.084643 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b8bf696d-8b4b-4bb8-894d-2d54ef0162bd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:36.085178 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b8bf696d-8b4b-4bb8-894d-2d54ef0162bd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:36.085694 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b8bf696d-8b4b-4bb8-894d-2d54ef0162bd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:36.105520 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=5,nova_cell1:UPDATE=5 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:45:36.288803 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-69ae3af4-8835-462f-a970-8a26c2af667c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:36.289570 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b8bf696d-8b4b-4bb8-894d-2d54ef0162bd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:36.296821 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-69ae3af4-8835-462f-a970-8a26c2af667c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1371 microversion: 2.1 time: 0.245110 Sep 06 22:45:36.300020 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b8bf696d-8b4b-4bb8-894d-2d54ef0162bd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:36.302223 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b8bf696d-8b4b-4bb8-894d-2d54ef0162bd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:36.303489 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b8bf696d-8b4b-4bb8-894d-2d54ef0162bd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1810 microversion: 2.20 time: 0.232334 Sep 06 22:45:36.304323 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 198/398] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:36 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1810 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 22:45:36.307839 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 201/399] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:36 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1371 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:37.319302 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b5c4ec32-2c16-43b6-bb84-f4f61d2a6f23 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:37.319906 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b5c4ec32-2c16-43b6-bb84-f4f61d2a6f23 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:37.326401 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b5c4ec32-2c16-43b6-bb84-f4f61d2a6f23 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:37.326908 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b5c4ec32-2c16-43b6-bb84-f4f61d2a6f23 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:37.327310 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b5c4ec32-2c16-43b6-bb84-f4f61d2a6f23 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:37.328502 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b5c4ec32-2c16-43b6-bb84-f4f61d2a6f23 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:37.328691 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b5c4ec32-2c16-43b6-bb84-f4f61d2a6f23 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:37.329116 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b5c4ec32-2c16-43b6-bb84-f4f61d2a6f23 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:37.332123 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-4f85e82f-f559-45f2-b5f4-9502a317625c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:37.332737 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-4f85e82f-f559-45f2-b5f4-9502a317625c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:37.342578 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4f85e82f-f559-45f2-b5f4-9502a317625c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:37.343764 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4f85e82f-f559-45f2-b5f4-9502a317625c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:37.344554 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4f85e82f-f559-45f2-b5f4-9502a317625c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:37.345200 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4f85e82f-f559-45f2-b5f4-9502a317625c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:37.345647 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4f85e82f-f559-45f2-b5f4-9502a317625c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:37.346063 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4f85e82f-f559-45f2-b5f4-9502a317625c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:37.538578 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b5c4ec32-2c16-43b6-bb84-f4f61d2a6f23 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:37.547149 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b5c4ec32-2c16-43b6-bb84-f4f61d2a6f23 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1371 microversion: 2.1 time: 0.230838 Sep 06 22:45:37.557278 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-4f85e82f-f559-45f2-b5f4-9502a317625c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:37.557941 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 199/400] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:37 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:37.574735 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-4f85e82f-f559-45f2-b5f4-9502a317625c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:37.576616 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-4f85e82f-f559-45f2-b5f4-9502a317625c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:37.579122 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-4f85e82f-f559-45f2-b5f4-9502a317625c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1810 microversion: 2.20 time: 0.251126 Sep 06 22:45:37.581813 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 202/401] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:37 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1810 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 22:45:38.321136 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5f9b149a-4123-48a9-83ab-07233c6dad61 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:38.321860 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5f9b149a-4123-48a9-83ab-07233c6dad61 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c9f58e44-e53c-4224-9b62-a3c23ba54ade] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:38.324874 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=4 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:45:38.334996 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5f9b149a-4123-48a9-83ab-07233c6dad61 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:38.335483 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5f9b149a-4123-48a9-83ab-07233c6dad61 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:38.335918 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5f9b149a-4123-48a9-83ab-07233c6dad61 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:38.336620 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5f9b149a-4123-48a9-83ab-07233c6dad61 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:38.337099 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5f9b149a-4123-48a9-83ab-07233c6dad61 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:38.337534 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5f9b149a-4123-48a9-83ab-07233c6dad61 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:38.367429 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5f9b149a-4123-48a9-83ab-07233c6dad61 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c9f58e44-e53c-4224-9b62-a3c23ba54ade] Going to try to terminate instance {{(pid=127088) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 22:45:38.447733 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5f9b149a-4123-48a9-83ab-07233c6dad61 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade" status: 204 len: 0 microversion: 2.1 time: 0.130759 Sep 06 22:45:38.448412 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 200/402] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Sep 6 22:45:38 2022] DELETE /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 22:45:38.458104 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d17023cf-d60e-4e46-9717-63c303813b90 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:38.458792 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-d17023cf-d60e-4e46-9717-63c303813b90 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c9f58e44-e53c-4224-9b62-a3c23ba54ade] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:38.464692 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d17023cf-d60e-4e46-9717-63c303813b90 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:38.466021 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d17023cf-d60e-4e46-9717-63c303813b90 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:38.466021 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d17023cf-d60e-4e46-9717-63c303813b90 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:38.467319 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d17023cf-d60e-4e46-9717-63c303813b90 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:38.467763 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d17023cf-d60e-4e46-9717-63c303813b90 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:38.468805 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d17023cf-d60e-4e46-9717-63c303813b90 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:38.580371 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4de262ec-8308-4af9-80e2-21e9d19451eb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:38.580371 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4de262ec-8308-4af9-80e2-21e9d19451eb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:38.586752 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4de262ec-8308-4af9-80e2-21e9d19451eb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:38.587381 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4de262ec-8308-4af9-80e2-21e9d19451eb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:38.587820 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4de262ec-8308-4af9-80e2-21e9d19451eb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:38.588520 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4de262ec-8308-4af9-80e2-21e9d19451eb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:38.588999 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4de262ec-8308-4af9-80e2-21e9d19451eb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:38.589487 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4de262ec-8308-4af9-80e2-21e9d19451eb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:38.629611 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-d17023cf-d60e-4e46-9717-63c303813b90 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8036279ef4384bdbfa8c37e46a1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebbea5186774c59942358c1fc284fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:38.642977 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d17023cf-d60e-4e46-9717-63c303813b90 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade" status: 200 len: 1513 microversion: 2.1 time: 0.189192 Sep 06 22:45:38.645298 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 203/403] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:38 2022] GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade => generated 1513 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:38.650760 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-7437cf4a-b48b-444b-b1e6-b36b99533c69 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:38.651588 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-7437cf4a-b48b-444b-b1e6-b36b99533c69 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:38.660668 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7437cf4a-b48b-444b-b1e6-b36b99533c69 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:38.661319 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7437cf4a-b48b-444b-b1e6-b36b99533c69 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:38.661989 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7437cf4a-b48b-444b-b1e6-b36b99533c69 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:38.662997 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7437cf4a-b48b-444b-b1e6-b36b99533c69 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:38.663628 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7437cf4a-b48b-444b-b1e6-b36b99533c69 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:38.664191 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7437cf4a-b48b-444b-b1e6-b36b99533c69 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:38.767778 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4de262ec-8308-4af9-80e2-21e9d19451eb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:38.779295 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4de262ec-8308-4af9-80e2-21e9d19451eb tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1371 microversion: 2.1 time: 0.211182 Sep 06 22:45:38.779877 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 201/404] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:38 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1371 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:45:38.846976 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-7437cf4a-b48b-444b-b1e6-b36b99533c69 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:38.855637 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-7437cf4a-b48b-444b-b1e6-b36b99533c69 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:38.857116 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-7437cf4a-b48b-444b-b1e6-b36b99533c69 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:38.858289 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-7437cf4a-b48b-444b-b1e6-b36b99533c69 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1810 microversion: 2.20 time: 0.211826 Sep 06 22:45:38.859722 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 204/405] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:38 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1810 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:45:39.669408 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e60fb47f-59f2-48ae-95bf-1f588a7dacfd tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:39.670669 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e60fb47f-59f2-48ae-95bf-1f588a7dacfd tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c9f58e44-e53c-4224-9b62-a3c23ba54ade] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:39.678523 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e60fb47f-59f2-48ae-95bf-1f588a7dacfd tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:39.679148 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e60fb47f-59f2-48ae-95bf-1f588a7dacfd tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:39.679668 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e60fb47f-59f2-48ae-95bf-1f588a7dacfd tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:39.680438 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e60fb47f-59f2-48ae-95bf-1f588a7dacfd tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:39.681059 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e60fb47f-59f2-48ae-95bf-1f588a7dacfd tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:39.681544 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e60fb47f-59f2-48ae-95bf-1f588a7dacfd tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:39.803570 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-7713fae8-0e73-48b1-b8f0-7a98131bcf51 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:39.804165 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-7713fae8-0e73-48b1-b8f0-7a98131bcf51 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:39.812884 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7713fae8-0e73-48b1-b8f0-7a98131bcf51 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:39.813786 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7713fae8-0e73-48b1-b8f0-7a98131bcf51 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:39.816800 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7713fae8-0e73-48b1-b8f0-7a98131bcf51 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:39.817884 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7713fae8-0e73-48b1-b8f0-7a98131bcf51 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:39.818545 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7713fae8-0e73-48b1-b8f0-7a98131bcf51 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:39.819142 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7713fae8-0e73-48b1-b8f0-7a98131bcf51 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:40.270316 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e60fb47f-59f2-48ae-95bf-1f588a7dacfd tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8036279ef4384bdbfa8c37e46a1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebbea5186774c59942358c1fc284fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:40.281271 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e60fb47f-59f2-48ae-95bf-1f588a7dacfd tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade" status: 200 len: 1513 microversion: 2.1 time: 0.615527 Sep 06 22:45:40.282182 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 202/406] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:39 2022] GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade => generated 1513 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:40.306540 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c30a7911-69a4-4b4c-8c08-cfc4c11e8f93 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:40.307164 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c30a7911-69a4-4b4c-8c08-cfc4c11e8f93 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:40.314172 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c30a7911-69a4-4b4c-8c08-cfc4c11e8f93 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:40.314669 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c30a7911-69a4-4b4c-8c08-cfc4c11e8f93 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:40.315102 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c30a7911-69a4-4b4c-8c08-cfc4c11e8f93 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:40.315806 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c30a7911-69a4-4b4c-8c08-cfc4c11e8f93 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:40.316442 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c30a7911-69a4-4b4c-8c08-cfc4c11e8f93 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:40.316887 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c30a7911-69a4-4b4c-8c08-cfc4c11e8f93 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:40.341335 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-7713fae8-0e73-48b1-b8f0-7a98131bcf51 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:40.353838 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-7713fae8-0e73-48b1-b8f0-7a98131bcf51 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1566 microversion: 2.1 time: 0.555031 Sep 06 22:45:40.360826 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 205/407] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:39 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1566 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:40.379025 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-66dbf596-5a2c-4231-8fd3-6af8976d6a32 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:40.379787 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-66dbf596-5a2c-4231-8fd3-6af8976d6a32 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:40.386085 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-66dbf596-5a2c-4231-8fd3-6af8976d6a32 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:40.386678 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-66dbf596-5a2c-4231-8fd3-6af8976d6a32 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:40.387386 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-66dbf596-5a2c-4231-8fd3-6af8976d6a32 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:40.388143 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-66dbf596-5a2c-4231-8fd3-6af8976d6a32 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:40.388825 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-66dbf596-5a2c-4231-8fd3-6af8976d6a32 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:40.389442 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-66dbf596-5a2c-4231-8fd3-6af8976d6a32 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:40.580064 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-66dbf596-5a2c-4231-8fd3-6af8976d6a32 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.200368 Sep 06 22:45:40.581344 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 206/408] 10.222.0.39 () {58 vars in 1275 bytes} [Tue Sep 6 22:45:40 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d/os-interface => generated 285 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 22:45:40.626282 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c30a7911-69a4-4b4c-8c08-cfc4c11e8f93 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:40.637357 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c30a7911-69a4-4b4c-8c08-cfc4c11e8f93 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:40.639444 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c30a7911-69a4-4b4c-8c08-cfc4c11e8f93 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:40.641754 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c30a7911-69a4-4b4c-8c08-cfc4c11e8f93 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1810 microversion: 2.20 time: 0.358019 Sep 06 22:45:40.642677 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 203/409] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:40 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1810 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:45:41.308381 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-3dda0142-2c33-4fde-8edb-1682f501a323 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:41.312601 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-3dda0142-2c33-4fde-8edb-1682f501a323 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c9f58e44-e53c-4224-9b62-a3c23ba54ade] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:41.322960 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3dda0142-2c33-4fde-8edb-1682f501a323 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:41.323631 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3dda0142-2c33-4fde-8edb-1682f501a323 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:41.324181 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3dda0142-2c33-4fde-8edb-1682f501a323 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:41.331995 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3dda0142-2c33-4fde-8edb-1682f501a323 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:41.332732 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3dda0142-2c33-4fde-8edb-1682f501a323 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:41.333838 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3dda0142-2c33-4fde-8edb-1682f501a323 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:41.649540 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3dda0142-2c33-4fde-8edb-1682f501a323 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8036279ef4384bdbfa8c37e46a1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebbea5186774c59942358c1fc284fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:41.670657 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7059de68-8ad6-4139-9127-8056f126b66d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:41.671463 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7059de68-8ad6-4139-9127-8056f126b66d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:41.682878 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7059de68-8ad6-4139-9127-8056f126b66d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:41.685488 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7059de68-8ad6-4139-9127-8056f126b66d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:41.685649 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-3dda0142-2c33-4fde-8edb-1682f501a323 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade" status: 200 len: 1513 microversion: 2.1 time: 0.379082 Sep 06 22:45:41.686303 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7059de68-8ad6-4139-9127-8056f126b66d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:41.686523 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 207/410] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:41 2022] GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade => generated 1513 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:41.688937 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7059de68-8ad6-4139-9127-8056f126b66d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:41.689631 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7059de68-8ad6-4139-9127-8056f126b66d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:41.691584 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7059de68-8ad6-4139-9127-8056f126b66d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:41.798504 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-1469a8ad-02df-470a-968a-07acf31debd1 req-01160103-9941-4dd5-97ed-d0b1240aa77f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b07b208-45e2-45aa-ad7b-bede527cfb6d", "tag": "bc5d6b1f-b033-4efc-ac9f-ff0f920a565c"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:45:41.811118 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-1469a8ad-02df-470a-968a-07acf31debd1 req-01160103-9941-4dd5-97ed-d0b1240aa77f service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:41.811786 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-1469a8ad-02df-470a-968a-07acf31debd1 req-01160103-9941-4dd5-97ed-d0b1240aa77f service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:41.812588 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-1469a8ad-02df-470a-968a-07acf31debd1 req-01160103-9941-4dd5-97ed-d0b1240aa77f service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:41.825507 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-1469a8ad-02df-470a-968a-07acf31debd1 req-01160103-9941-4dd5-97ed-d0b1240aa77f service nova] Creating event network-changed:bc5d6b1f-b033-4efc-ac9f-ff0f920a565c for instance 7b07b208-45e2-45aa-ad7b-bede527cfb6d on hv-cinder-85220 Sep 06 22:45:41.840307 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-1469a8ad-02df-470a-968a-07acf31debd1 req-01160103-9941-4dd5-97ed-d0b1240aa77f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046126 Sep 06 22:45:41.841350 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 208/411] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 22:45:41.927587 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7059de68-8ad6-4139-9127-8056f126b66d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:41.938859 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7059de68-8ad6-4139-9127-8056f126b66d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:41.941096 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7059de68-8ad6-4139-9127-8056f126b66d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:41.942397 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7059de68-8ad6-4139-9127-8056f126b66d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1750 microversion: 2.20 time: 0.276079 Sep 06 22:45:41.953049 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 204/412] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:41 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1750 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 22:45:42.711164 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-01d25a4e-5097-47f5-ba4b-e828444d895b tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:42.712713 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-01d25a4e-5097-47f5-ba4b-e828444d895b tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c9f58e44-e53c-4224-9b62-a3c23ba54ade] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:42.722309 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-01d25a4e-5097-47f5-ba4b-e828444d895b tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:42.723237 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-01d25a4e-5097-47f5-ba4b-e828444d895b tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:42.723825 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-01d25a4e-5097-47f5-ba4b-e828444d895b tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:42.724602 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-01d25a4e-5097-47f5-ba4b-e828444d895b tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:42.725347 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-01d25a4e-5097-47f5-ba4b-e828444d895b tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:42.725994 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-01d25a4e-5097-47f5-ba4b-e828444d895b tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:42.973911 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b04dea76-ad3e-4641-89fe-08bb515c616f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:42.981592 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b04dea76-ad3e-4641-89fe-08bb515c616f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:42.994545 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b04dea76-ad3e-4641-89fe-08bb515c616f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:42.999046 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b04dea76-ad3e-4641-89fe-08bb515c616f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:43.000184 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b04dea76-ad3e-4641-89fe-08bb515c616f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:43.001108 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b04dea76-ad3e-4641-89fe-08bb515c616f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:43.004500 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b04dea76-ad3e-4641-89fe-08bb515c616f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:43.005261 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b04dea76-ad3e-4641-89fe-08bb515c616f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:43.207937 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-01d25a4e-5097-47f5-ba4b-e828444d895b tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8036279ef4384bdbfa8c37e46a1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebbea5186774c59942358c1fc284fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:43.228941 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-01d25a4e-5097-47f5-ba4b-e828444d895b tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade" status: 200 len: 1513 microversion: 2.1 time: 0.517919 Sep 06 22:45:43.228941 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 209/413] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:42 2022] GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade => generated 1513 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:43.303202 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b04dea76-ad3e-4641-89fe-08bb515c616f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:43.319648 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b04dea76-ad3e-4641-89fe-08bb515c616f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:43.325726 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b04dea76-ad3e-4641-89fe-08bb515c616f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:43.333417 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b04dea76-ad3e-4641-89fe-08bb515c616f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1750 microversion: 2.20 time: 0.368167 Sep 06 22:45:43.346188 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 205/414] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:42 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1750 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 22:45:44.252479 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-0e86a061-f764-46fd-87e2-72dc5c87ca87 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:44.253217 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-0e86a061-f764-46fd-87e2-72dc5c87ca87 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c9f58e44-e53c-4224-9b62-a3c23ba54ade] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:44.262026 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0e86a061-f764-46fd-87e2-72dc5c87ca87 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:44.262784 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0e86a061-f764-46fd-87e2-72dc5c87ca87 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:44.263455 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0e86a061-f764-46fd-87e2-72dc5c87ca87 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:44.264455 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0e86a061-f764-46fd-87e2-72dc5c87ca87 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:44.265809 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0e86a061-f764-46fd-87e2-72dc5c87ca87 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:44.266344 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0e86a061-f764-46fd-87e2-72dc5c87ca87 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:44.377010 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7b295ffe-e951-44f6-8e51-ebc54f8fa0d0 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:44.379568 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7b295ffe-e951-44f6-8e51-ebc54f8fa0d0 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:44.387987 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:45:44.407573 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7b295ffe-e951-44f6-8e51-ebc54f8fa0d0 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:44.408136 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7b295ffe-e951-44f6-8e51-ebc54f8fa0d0 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:44.408554 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7b295ffe-e951-44f6-8e51-ebc54f8fa0d0 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:44.409569 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7b295ffe-e951-44f6-8e51-ebc54f8fa0d0 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:44.414986 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7b295ffe-e951-44f6-8e51-ebc54f8fa0d0 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:44.415437 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7b295ffe-e951-44f6-8e51-ebc54f8fa0d0 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:44.422465 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-0e86a061-f764-46fd-87e2-72dc5c87ca87 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8036279ef4384bdbfa8c37e46a1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebbea5186774c59942358c1fc284fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:44.431872 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-0e86a061-f764-46fd-87e2-72dc5c87ca87 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade" status: 200 len: 1513 microversion: 2.1 time: 0.184591 Sep 06 22:45:44.433072 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 210/415] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:44 2022] GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade => generated 1513 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:44.589659 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7b295ffe-e951-44f6-8e51-ebc54f8fa0d0 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:44.599789 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-e2c345b9-d89a-4be4-b403-a6b7235b8b45 req-b5553286-a579-46c8-8467-31fe5b7e6759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f58e44-e53c-4224-9b62-a3c23ba54ade", "name": "network-vif-unplugged", "status": "completed", "tag": "a21dfb14-4ae3-4c83-a2bc-bb4f7e665bbc"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:45:44.638614 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7b295ffe-e951-44f6-8e51-ebc54f8fa0d0 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:44.641654 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-e2c345b9-d89a-4be4-b403-a6b7235b8b45 req-b5553286-a579-46c8-8467-31fe5b7e6759 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:44.642133 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-e2c345b9-d89a-4be4-b403-a6b7235b8b45 req-b5553286-a579-46c8-8467-31fe5b7e6759 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:44.642549 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-e2c345b9-d89a-4be4-b403-a6b7235b8b45 req-b5553286-a579-46c8-8467-31fe5b7e6759 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:44.643600 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7b295ffe-e951-44f6-8e51-ebc54f8fa0d0 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:44.644864 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7b295ffe-e951-44f6-8e51-ebc54f8fa0d0 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1750 microversion: 2.20 time: 0.281387 Sep 06 22:45:44.645992 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 206/416] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:44 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1750 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:45:44.673095 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-e2c345b9-d89a-4be4-b403-a6b7235b8b45 req-b5553286-a579-46c8-8467-31fe5b7e6759 service nova] Creating event network-vif-unplugged:a21dfb14-4ae3-4c83-a2bc-bb4f7e665bbc for instance c9f58e44-e53c-4224-9b62-a3c23ba54ade on hv-cinder-85220 Sep 06 22:45:44.678282 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-e2c345b9-d89a-4be4-b403-a6b7235b8b45 req-b5553286-a579-46c8-8467-31fe5b7e6759 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085372 Sep 06 22:45:44.679042 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 211/417] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 22:45:45.458467 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fc4cdb35-73cb-4f98-9eb0-41cb75c5e094 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:45.459144 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fc4cdb35-73cb-4f98-9eb0-41cb75c5e094 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c9f58e44-e53c-4224-9b62-a3c23ba54ade] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:45.467502 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fc4cdb35-73cb-4f98-9eb0-41cb75c5e094 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:45.468609 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fc4cdb35-73cb-4f98-9eb0-41cb75c5e094 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:45.469157 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fc4cdb35-73cb-4f98-9eb0-41cb75c5e094 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:45.469927 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fc4cdb35-73cb-4f98-9eb0-41cb75c5e094 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:45.470589 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fc4cdb35-73cb-4f98-9eb0-41cb75c5e094 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:45.472097 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fc4cdb35-73cb-4f98-9eb0-41cb75c5e094 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:45.676481 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-3ae2c2fb-2610-4c1b-938c-d6792b4af691 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:45.677462 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-3ae2c2fb-2610-4c1b-938c-d6792b4af691 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:45.682063 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fc4cdb35-73cb-4f98-9eb0-41cb75c5e094 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8036279ef4384bdbfa8c37e46a1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebbea5186774c59942358c1fc284fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:45.691954 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3ae2c2fb-2610-4c1b-938c-d6792b4af691 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:45.692332 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fc4cdb35-73cb-4f98-9eb0-41cb75c5e094 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade" status: 200 len: 1513 microversion: 2.1 time: 0.238386 Sep 06 22:45:45.692748 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3ae2c2fb-2610-4c1b-938c-d6792b4af691 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:45.693499 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3ae2c2fb-2610-4c1b-938c-d6792b4af691 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:45.694350 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3ae2c2fb-2610-4c1b-938c-d6792b4af691 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:45.695810 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3ae2c2fb-2610-4c1b-938c-d6792b4af691 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:45.696466 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3ae2c2fb-2610-4c1b-938c-d6792b4af691 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:45.706446 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 207/418] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:45 2022] GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade => generated 1513 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:45.886499 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3ae2c2fb-2610-4c1b-938c-d6792b4af691 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:45.898918 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3ae2c2fb-2610-4c1b-938c-d6792b4af691 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:45.900852 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3ae2c2fb-2610-4c1b-938c-d6792b4af691 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:45.902288 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-3ae2c2fb-2610-4c1b-938c-d6792b4af691 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1750 microversion: 2.20 time: 0.232637 Sep 06 22:45:45.903444 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 212/419] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:45 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1750 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:45:46.733974 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-37c7e8e3-a603-4887-9dfe-626e6277ceb0 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:46.735217 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-37c7e8e3-a603-4887-9dfe-626e6277ceb0 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c9f58e44-e53c-4224-9b62-a3c23ba54ade] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:46.749864 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-37c7e8e3-a603-4887-9dfe-626e6277ceb0 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:46.750877 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-37c7e8e3-a603-4887-9dfe-626e6277ceb0 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:46.751488 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-37c7e8e3-a603-4887-9dfe-626e6277ceb0 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:46.752401 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-37c7e8e3-a603-4887-9dfe-626e6277ceb0 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:46.752898 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-37c7e8e3-a603-4887-9dfe-626e6277ceb0 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:46.753327 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-37c7e8e3-a603-4887-9dfe-626e6277ceb0 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:46.930610 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f9c0b048-28e6-4ace-ae32-651d60591f19 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:46.931958 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-f9c0b048-28e6-4ace-ae32-651d60591f19 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:46.942197 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f9c0b048-28e6-4ace-ae32-651d60591f19 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:46.943083 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f9c0b048-28e6-4ace-ae32-651d60591f19 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:46.943760 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f9c0b048-28e6-4ace-ae32-651d60591f19 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:46.945461 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f9c0b048-28e6-4ace-ae32-651d60591f19 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:46.946135 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f9c0b048-28e6-4ace-ae32-651d60591f19 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:46.946862 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f9c0b048-28e6-4ace-ae32-651d60591f19 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:47.398076 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-f9c0b048-28e6-4ace-ae32-651d60591f19 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:47.408684 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-f9c0b048-28e6-4ace-ae32-651d60591f19 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:47.417345 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-f9c0b048-28e6-4ace-ae32-651d60591f19 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:47.418865 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-f9c0b048-28e6-4ace-ae32-651d60591f19 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1752 microversion: 2.20 time: 0.493503 Sep 06 22:45:47.426760 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 213/420] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:46 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1752 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 22:45:47.454951 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-37c7e8e3-a603-4887-9dfe-626e6277ceb0 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8036279ef4384bdbfa8c37e46a1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebbea5186774c59942358c1fc284fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:47.469495 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-37c7e8e3-a603-4887-9dfe-626e6277ceb0 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade" status: 200 len: 1513 microversion: 2.1 time: 0.738174 Sep 06 22:45:47.470577 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 208/421] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:46 2022] GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade => generated 1513 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:48.456571 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-1956356a-cb1e-41c4-a422-71bb2b613e57 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:48.457222 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-1956356a-cb1e-41c4-a422-71bb2b613e57 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:48.464330 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=68 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:45:48.487604 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1956356a-cb1e-41c4-a422-71bb2b613e57 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:48.488674 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1956356a-cb1e-41c4-a422-71bb2b613e57 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:48.490506 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1956356a-cb1e-41c4-a422-71bb2b613e57 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:48.491655 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1956356a-cb1e-41c4-a422-71bb2b613e57 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:48.494655 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1956356a-cb1e-41c4-a422-71bb2b613e57 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:48.496066 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1956356a-cb1e-41c4-a422-71bb2b613e57 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:48.502647 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f3c3d6f8-8443-40e5-adeb-8c2f32ff568c tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:48.503254 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f3c3d6f8-8443-40e5-adeb-8c2f32ff568c tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c9f58e44-e53c-4224-9b62-a3c23ba54ade] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:48.516444 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f3c3d6f8-8443-40e5-adeb-8c2f32ff568c tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:48.516974 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f3c3d6f8-8443-40e5-adeb-8c2f32ff568c tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:48.519982 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f3c3d6f8-8443-40e5-adeb-8c2f32ff568c tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:48.532110 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f3c3d6f8-8443-40e5-adeb-8c2f32ff568c tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:48.534523 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f3c3d6f8-8443-40e5-adeb-8c2f32ff568c tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:48.535148 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f3c3d6f8-8443-40e5-adeb-8c2f32ff568c tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:49.042008 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-1956356a-cb1e-41c4-a422-71bb2b613e57 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:49.058753 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-1956356a-cb1e-41c4-a422-71bb2b613e57 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:49.068575 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-1956356a-cb1e-41c4-a422-71bb2b613e57 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:49.072062 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-1956356a-cb1e-41c4-a422-71bb2b613e57 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1752 microversion: 2.20 time: 0.621576 Sep 06 22:45:49.074952 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 214/422] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:48 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1752 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:45:49.093504 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-125db6cb-42b6-49fd-af74-3bd06844007a req-bb3f97dd-7512-4a35-a3ae-223f3fa64093 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f58e44-e53c-4224-9b62-a3c23ba54ade", "name": "network-vif-deleted", "tag": "a21dfb14-4ae3-4c83-a2bc-bb4f7e665bbc"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:45:49.119660 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-125db6cb-42b6-49fd-af74-3bd06844007a req-bb3f97dd-7512-4a35-a3ae-223f3fa64093 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:49.121500 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-125db6cb-42b6-49fd-af74-3bd06844007a req-bb3f97dd-7512-4a35-a3ae-223f3fa64093 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:49.121939 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-125db6cb-42b6-49fd-af74-3bd06844007a req-bb3f97dd-7512-4a35-a3ae-223f3fa64093 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:49.133902 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f3c3d6f8-8443-40e5-adeb-8c2f32ff568c tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8036279ef4384bdbfa8c37e46a1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebbea5186774c59942358c1fc284fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:49.147422 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f3c3d6f8-8443-40e5-adeb-8c2f32ff568c tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade" status: 200 len: 1513 microversion: 2.1 time: 0.649537 Sep 06 22:45:49.149113 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 209/423] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:48 2022] GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade => generated 1513 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:49.154692 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-125db6cb-42b6-49fd-af74-3bd06844007a req-bb3f97dd-7512-4a35-a3ae-223f3fa64093 service nova] Creating event network-vif-deleted:a21dfb14-4ae3-4c83-a2bc-bb4f7e665bbc for instance c9f58e44-e53c-4224-9b62-a3c23ba54ade on hv-cinder-85220 Sep 06 22:45:49.178198 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-125db6cb-42b6-49fd-af74-3bd06844007a req-bb3f97dd-7512-4a35-a3ae-223f3fa64093 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101248 Sep 06 22:45:49.181398 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 215/424] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:45:50.111719 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0457d2d3-5edc-4773-982a-50c9474fde1f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:50.112425 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0457d2d3-5edc-4773-982a-50c9474fde1f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:50.123764 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0457d2d3-5edc-4773-982a-50c9474fde1f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:50.126350 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0457d2d3-5edc-4773-982a-50c9474fde1f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:50.127492 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0457d2d3-5edc-4773-982a-50c9474fde1f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:50.131167 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0457d2d3-5edc-4773-982a-50c9474fde1f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:50.133319 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0457d2d3-5edc-4773-982a-50c9474fde1f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:50.133977 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0457d2d3-5edc-4773-982a-50c9474fde1f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:50.178703 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9c563010-5c40-476a-ad6b-5f986cb7fbb7 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:50.180056 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9c563010-5c40-476a-ad6b-5f986cb7fbb7 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c9f58e44-e53c-4224-9b62-a3c23ba54ade] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:50.192124 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9c563010-5c40-476a-ad6b-5f986cb7fbb7 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:50.195100 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9c563010-5c40-476a-ad6b-5f986cb7fbb7 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:50.195742 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9c563010-5c40-476a-ad6b-5f986cb7fbb7 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:50.199545 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9c563010-5c40-476a-ad6b-5f986cb7fbb7 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:50.200215 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9c563010-5c40-476a-ad6b-5f986cb7fbb7 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:50.200915 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9c563010-5c40-476a-ad6b-5f986cb7fbb7 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:50.315827 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9c563010-5c40-476a-ad6b-5f986cb7fbb7 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:50.316331 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9c563010-5c40-476a-ad6b-5f986cb7fbb7 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:50.316852 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9c563010-5c40-476a-ad6b-5f986cb7fbb7 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:50.317311 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.objects.instance [None req-9c563010-5c40-476a-ad6b-5f986cb7fbb7 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lazy-loading 'fault' on Instance uuid c9f58e44-e53c-4224-9b62-a3c23ba54ade {{(pid=127087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 22:45:50.509062 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9c563010-5c40-476a-ad6b-5f986cb7fbb7 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8036279ef4384bdbfa8c37e46a1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebbea5186774c59942358c1fc284fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:50.522371 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9c563010-5c40-476a-ad6b-5f986cb7fbb7 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade" status: 200 len: 1309 microversion: 2.1 time: 0.349449 Sep 06 22:45:50.523585 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 216/425] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:50 2022] GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade => generated 1309 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:50.570275 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-036ca384-a8c5-4b65-9257-e40ab6a54d92 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-690973515", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1102918603", "security_groups": [{"name": "tempest-secgroup-smoke-1541823835"}], "block_device_mapping_v2": [{"uuid": "0c6219f8-9a89-48a2-8eb0-3d7efd53b5e3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "58d448a5-1081-4b4c-a11f-e7854551fb17"}]}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:45:50.673880 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0457d2d3-5edc-4773-982a-50c9474fde1f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:50.687792 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0457d2d3-5edc-4773-982a-50c9474fde1f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:50.690034 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0457d2d3-5edc-4773-982a-50c9474fde1f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:50.691416 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0457d2d3-5edc-4773-982a-50c9474fde1f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1808 microversion: 2.20 time: 0.591300 Sep 06 22:45:50.707702 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 210/426] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:50 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1808 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:45:50.880647 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.network.neutron [None req-036ca384-a8c5-4b65-9257-e40ab6a54d92 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] validate_networks() for [('58d448a5-1081-4b4c-a11f-e7854551fb17', None, None, None, None, None)] {{(pid=127087) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 22:45:51.011535 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bff86238-d38a-404b-80de-f22342a4386f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Action: 'create', calling method: .version_select at 0x7f9c4f7271f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1356466728", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2jGX2dZq600dlwyPc2YDuB3Zw1QPGCiqlcAbSUwFIN3KfSEh9rkJZcGmDOB/BjJ0djHOpsl1E1SXIFdEHmRvzsp4eBlAGyymasO97ubcvGqVUAg8XOPF31zvfeGoo9cw=="}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:45:51.029055 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-bff86238-d38a-404b-80de-f22342a4386f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Getting quotas for project 410f8fc9cc284ba78edf9f4db25f9d31. Resources: {'key_pairs'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 22:45:51.039014 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-bff86238-d38a-404b-80de-f22342a4386f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Getting quotas for user bcede7fa39dd47f7ba80c5add2c0f750 and project 410f8fc9cc284ba78edf9f4db25f9d31. Resources: {'key_pairs'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 22:45:51.073656 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bff86238-d38a-404b-80de-f22342a4386f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.281068 Sep 06 22:45:51.074575 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 211/427] 10.222.0.39 () {60 vars in 1159 bytes} [Tue Sep 6 22:45:50 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 22:45:51.558421 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bc4f2de0-4c7d-4eb1-8028-12e37307247e tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:51.559267 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bc4f2de0-4c7d-4eb1-8028-12e37307247e tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c9f58e44-e53c-4224-9b62-a3c23ba54ade] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:51.569926 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc4f2de0-4c7d-4eb1-8028-12e37307247e tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:51.571010 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc4f2de0-4c7d-4eb1-8028-12e37307247e tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:51.571835 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc4f2de0-4c7d-4eb1-8028-12e37307247e tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:51.572807 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc4f2de0-4c7d-4eb1-8028-12e37307247e tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:51.573329 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc4f2de0-4c7d-4eb1-8028-12e37307247e tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:51.574015 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bc4f2de0-4c7d-4eb1-8028-12e37307247e tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:51.599166 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-bc4f2de0-4c7d-4eb1-8028-12e37307247e tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] HTTP exception thrown: Instance c9f58e44-e53c-4224-9b62-a3c23ba54ade could not be found. Sep 06 22:45:51.601410 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bc4f2de0-4c7d-4eb1-8028-12e37307247e tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Request method failure captured: Sep 06 22:45:51.601410 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade HTTP/1.1 Sep 06 22:45:51.601410 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept: application/json Sep 06 22:45:51.601410 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Sep 06 22:45:51.601410 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Connection: close Sep 06 22:45:51.601410 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Length: 0 Sep 06 22:45:51.601410 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Type: application/json Sep 06 22:45:51.601410 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Host: 10.222.0.39 Sep 06 22:45:51.601410 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Sep 06 22:45:51.601410 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Sep 06 22:45:51.601410 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjF81N1UqyK-rk9BoRTUUq9BjoECvFuklBW8kgntIrYOIyqHy7jyt5eNCIvoZHe_o4u9a7fN1qFNe3NipLkHKkM6qUdat8sxmb_95GdCIN599ImF3GDaQvIWdM3FuBetJw6cMT6G-19v2okgMPHj-9XIRgAWnEU-5D1wMjxInMtnkmG9Y Sep 06 22:45:51.601410 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Sep 06 22:45:51.601410 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Sep 06 22:45:51.601410 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Sep 06 22:45:51.601410 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Sep 06 22:45:51.601410 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Sep 06 22:45:51.601410 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Sep 06 22:45:51.601410 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Id: 3ebbea5186774c59942358c1fc284fa7 Sep 06 22:45:51.601410 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-VolumesSnapshotTestJSON-426490102 Sep 06 22:45:51.601410 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Role: reader,member Sep 06 22:45:51.601410 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Sep 06 22:45:51.603037 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3ebbea5186774c59942358c1fc284fa7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3ebbea5186774c59942358c1fc284fa7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3ebbea5186774c59942358c1fc284fa7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3ebbea5186774c59942358c1fc284fa7"}]}] Sep 06 22:45:51.603037 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-VolumesSnapshotTestJSON-426490102 Sep 06 22:45:51.603037 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 3ebbea5186774c59942358c1fc284fa7 Sep 06 22:45:51.603037 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-426490102 Sep 06 22:45:51.603037 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User: tempest-VolumesSnapshotTestJSON-426490102-project Sep 06 22:45:51.603037 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Sep 06 22:45:51.603037 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Sep 06 22:45:51.603037 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Id: 81d8036279ef4384bdbfa8c37e46a1d6 Sep 06 22:45:51.603037 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-VolumesSnapshotTestJSON-426490102-project Sep 06 22:45:51.603037 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: method: > Sep 06 22:45:51.603037 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: exception: Instance c9f58e44-e53c-4224-9b62-a3c23ba54ade could not be found. Sep 06 22:45:51.603037 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: action_args: {'id': 'c9f58e44-e53c-4224-9b62-a3c23ba54ade'} Sep 06 22:45:51.603786 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:45:51.603786 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:45:51.603786 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:45:51.603786 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:45:51.603786 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:45:51.603786 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:45:51.603786 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:45:51.603786 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:45:51.603786 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:45:51.603786 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:45:51.603786 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9f58e44-e53c-4224-9b62-a3c23ba54ade could not be found. Sep 06 22:45:51.603786 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:45:51.603786 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:45:51.603786 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:45:51.603786 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:45:51.603786 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:45:51.603786 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:45:51.603786 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:45:51.603786 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:45:51.603786 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:45:51.605143 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:45:51.605143 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 22:45:51.605143 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 22:45:51.605143 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:45:51.605143 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:45:51.605143 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:45:51.605143 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:45:51.605143 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9f58e44-e53c-4224-9b62-a3c23ba54ade could not be found. Sep 06 22:45:51.605143 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:45:51.605143 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:45:51.605143 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:45:51.605143 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:45:51.605143 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:45:51.605143 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:45:51.605143 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:45:51.605143 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:45:51.605143 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9f58e44-e53c-4224-9b62-a3c23ba54ade could not be found. Sep 06 22:45:51.605143 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:45:51.607023 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bc4f2de0-4c7d-4eb1-8028-12e37307247e tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Returning 404 to user: Instance c9f58e44-e53c-4224-9b62-a3c23ba54ade could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:45:51.607023 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bc4f2de0-4c7d-4eb1-8028-12e37307247e tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade" status: 404 len: 111 microversion: 2.1 time: 0.058818 Sep 06 22:45:51.607482 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 212/428] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:51 2022] GET /compute/v2.1/servers/c9f58e44-e53c-4224-9b62-a3c23ba54ade => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 22:45:51.727370 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-25060a49-0c4e-4aca-b3fb-ae754ccba27a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:51.729553 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-25060a49-0c4e-4aca-b3fb-ae754ccba27a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:51.739714 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25060a49-0c4e-4aca-b3fb-ae754ccba27a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:51.740667 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25060a49-0c4e-4aca-b3fb-ae754ccba27a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:51.741703 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25060a49-0c4e-4aca-b3fb-ae754ccba27a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:51.742662 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25060a49-0c4e-4aca-b3fb-ae754ccba27a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:51.745130 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25060a49-0c4e-4aca-b3fb-ae754ccba27a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:51.745839 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-25060a49-0c4e-4aca-b3fb-ae754ccba27a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:52.037571 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-036ca384-a8c5-4b65-9257-e40ab6a54d92 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Flavor limits 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 22:45:52.038315 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-036ca384-a8c5-4b65-9257-e40ab6a54d92 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Image limits 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 22:45:52.039083 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-036ca384-a8c5-4b65-9257-e40ab6a54d92 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Flavor pref 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 22:45:52.039738 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-036ca384-a8c5-4b65-9257-e40ab6a54d92 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Image pref 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 22:45:52.040144 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-036ca384-a8c5-4b65-9257-e40ab6a54d92 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 22:45:52.054364 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-036ca384-a8c5-4b65-9257-e40ab6a54d92 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:52.055205 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-036ca384-a8c5-4b65-9257-e40ab6a54d92 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:52.055864 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-036ca384-a8c5-4b65-9257-e40ab6a54d92 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:52.057390 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-036ca384-a8c5-4b65-9257-e40ab6a54d92 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:52.058026 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-036ca384-a8c5-4b65-9257-e40ab6a54d92 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:52.058618 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-036ca384-a8c5-4b65-9257-e40ab6a54d92 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:52.083572 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-036ca384-a8c5-4b65-9257-e40ab6a54d92 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Getting quotas for project cc47231427ec4337833eb5d733b211bc. Resources: {'instances', 'ram', 'cores'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 22:45:52.088186 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-036ca384-a8c5-4b65-9257-e40ab6a54d92 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Getting quotas for user 29018ec15cc147d3919d9047569a4c68 and project cc47231427ec4337833eb5d733b211bc. Resources: {'instances', 'ram', 'cores'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 22:45:52.156463 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-25060a49-0c4e-4aca-b3fb-ae754ccba27a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:52.183966 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-036ca384-a8c5-4b65-9257-e40ab6a54d92 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Going to run 1 instances... {{(pid=127087) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 22:45:52.185629 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-25060a49-0c4e-4aca-b3fb-ae754ccba27a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:52.186408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-036ca384-a8c5-4b65-9257-e40ab6a54d92 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0c6219f8-9a89-48a2-8eb0-3d7efd53b5e3',volume_size=None,volume_type=None)] {{(pid=127087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 22:45:52.187629 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-25060a49-0c4e-4aca-b3fb-ae754ccba27a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:52.188867 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-25060a49-0c4e-4aca-b3fb-ae754ccba27a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1808 microversion: 2.20 time: 0.471755 Sep 06 22:45:52.191633 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 213/429] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:51 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1808 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:45:52.378181 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-036ca384-a8c5-4b65-9257-e40ab6a54d92 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.813198 Sep 06 22:45:52.379110 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 217/430] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Sep 6 22:45:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 1815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 22:45:52.404215 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-97f6ff6a-adb3-4cd5-8306-2f47ce6c326a tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:52.406493 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-97f6ff6a-adb3-4cd5-8306-2f47ce6c326a tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:52.560493 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-97f6ff6a-adb3-4cd5-8306-2f47ce6c326a tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:52.577907 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-97f6ff6a-adb3-4cd5-8306-2f47ce6c326a tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126" status: 200 len: 1094 microversion: 2.1 time: 0.189906 Sep 06 22:45:52.583143 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 214/431] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:52 2022] GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 => generated 1094 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:53.219041 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-77faa634-f84b-49dd-b245-d3f2dc10baf3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:53.219926 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-77faa634-f84b-49dd-b245-d3f2dc10baf3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:53.226654 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-77faa634-f84b-49dd-b245-d3f2dc10baf3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:53.227377 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-77faa634-f84b-49dd-b245-d3f2dc10baf3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:53.227866 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-77faa634-f84b-49dd-b245-d3f2dc10baf3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:53.228808 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-77faa634-f84b-49dd-b245-d3f2dc10baf3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:53.229422 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-77faa634-f84b-49dd-b245-d3f2dc10baf3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:53.229991 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-77faa634-f84b-49dd-b245-d3f2dc10baf3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:53.380583 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-77faa634-f84b-49dd-b245-d3f2dc10baf3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:53.389698 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-77faa634-f84b-49dd-b245-d3f2dc10baf3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:53.392010 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-77faa634-f84b-49dd-b245-d3f2dc10baf3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:53.393297 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-77faa634-f84b-49dd-b245-d3f2dc10baf3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1808 microversion: 2.20 time: 0.180448 Sep 06 22:45:53.393935 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 218/432] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:53 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 22:45:53.603316 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b126d3b6-06df-4620-87a8-0d162c2d4bb0 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:53.603922 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b126d3b6-06df-4620-87a8-0d162c2d4bb0 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:53.611558 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b126d3b6-06df-4620-87a8-0d162c2d4bb0 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:53.612046 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b126d3b6-06df-4620-87a8-0d162c2d4bb0 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:53.612468 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b126d3b6-06df-4620-87a8-0d162c2d4bb0 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:53.613194 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b126d3b6-06df-4620-87a8-0d162c2d4bb0 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:53.613641 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b126d3b6-06df-4620-87a8-0d162c2d4bb0 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:53.614058 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b126d3b6-06df-4620-87a8-0d162c2d4bb0 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:53.674341 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b126d3b6-06df-4620-87a8-0d162c2d4bb0 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:53.681942 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b126d3b6-06df-4620-87a8-0d162c2d4bb0 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126" status: 200 len: 1144 microversion: 2.1 time: 0.082601 Sep 06 22:45:53.682507 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 215/433] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:53 2022] GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:54.419299 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b434b1a7-6be1-4503-af99-e58fdf684238 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:54.419934 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b434b1a7-6be1-4503-af99-e58fdf684238 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:54.425802 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b434b1a7-6be1-4503-af99-e58fdf684238 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:54.426271 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b434b1a7-6be1-4503-af99-e58fdf684238 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:54.426692 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b434b1a7-6be1-4503-af99-e58fdf684238 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:54.427362 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b434b1a7-6be1-4503-af99-e58fdf684238 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:54.427802 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b434b1a7-6be1-4503-af99-e58fdf684238 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:54.428210 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b434b1a7-6be1-4503-af99-e58fdf684238 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:54.556899 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b434b1a7-6be1-4503-af99-e58fdf684238 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:54.566415 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b434b1a7-6be1-4503-af99-e58fdf684238 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:54.567928 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b434b1a7-6be1-4503-af99-e58fdf684238 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:54.569085 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b434b1a7-6be1-4503-af99-e58fdf684238 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1808 microversion: 2.20 time: 0.153620 Sep 06 22:45:54.569629 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 219/434] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:54 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:45:54.705557 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-71e0411b-fd98-42cc-9022-c7b6389bca86 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:54.706174 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-71e0411b-fd98-42cc-9022-c7b6389bca86 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:54.713604 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-71e0411b-fd98-42cc-9022-c7b6389bca86 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:54.714262 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-71e0411b-fd98-42cc-9022-c7b6389bca86 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:54.714693 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-71e0411b-fd98-42cc-9022-c7b6389bca86 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:54.715825 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-71e0411b-fd98-42cc-9022-c7b6389bca86 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:54.716278 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-71e0411b-fd98-42cc-9022-c7b6389bca86 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:54.716730 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-71e0411b-fd98-42cc-9022-c7b6389bca86 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:54.722568 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:45:54.806777 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-71e0411b-fd98-42cc-9022-c7b6389bca86 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:54.816239 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-71e0411b-fd98-42cc-9022-c7b6389bca86 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126" status: 200 len: 1144 microversion: 2.1 time: 0.115156 Sep 06 22:45:54.816845 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 216/435] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:54 2022] GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 => generated 1144 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:55.596387 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-54dd1ba2-8293-4cd0-bd95-00e6f4f8a04b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:55.597944 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-54dd1ba2-8293-4cd0-bd95-00e6f4f8a04b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:55.613963 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-54dd1ba2-8293-4cd0-bd95-00e6f4f8a04b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:55.617481 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-54dd1ba2-8293-4cd0-bd95-00e6f4f8a04b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:55.625232 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-54dd1ba2-8293-4cd0-bd95-00e6f4f8a04b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:55.626550 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-54dd1ba2-8293-4cd0-bd95-00e6f4f8a04b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:55.627402 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-54dd1ba2-8293-4cd0-bd95-00e6f4f8a04b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:55.631301 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-54dd1ba2-8293-4cd0-bd95-00e6f4f8a04b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:55.636835 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=100 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:45:55.810941 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-54dd1ba2-8293-4cd0-bd95-00e6f4f8a04b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:55.821600 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-54dd1ba2-8293-4cd0-bd95-00e6f4f8a04b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:55.823069 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-54dd1ba2-8293-4cd0-bd95-00e6f4f8a04b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:55.824451 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-54dd1ba2-8293-4cd0-bd95-00e6f4f8a04b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1808 microversion: 2.20 time: 0.232641 Sep 06 22:45:55.825207 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 220/436] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:55 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1808 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:45:55.838996 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1dca1d32-bb4c-4424-8895-3ae6d2ed2e41 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:55.839571 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1dca1d32-bb4c-4424-8895-3ae6d2ed2e41 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:55.847068 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1dca1d32-bb4c-4424-8895-3ae6d2ed2e41 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:55.847803 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1dca1d32-bb4c-4424-8895-3ae6d2ed2e41 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:55.848394 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1dca1d32-bb4c-4424-8895-3ae6d2ed2e41 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:55.849289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1dca1d32-bb4c-4424-8895-3ae6d2ed2e41 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:55.849735 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1dca1d32-bb4c-4424-8895-3ae6d2ed2e41 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:55.850316 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1dca1d32-bb4c-4424-8895-3ae6d2ed2e41 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:55.919824 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1dca1d32-bb4c-4424-8895-3ae6d2ed2e41 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:55.928267 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1dca1d32-bb4c-4424-8895-3ae6d2ed2e41 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126" status: 200 len: 1144 microversion: 2.1 time: 0.093218 Sep 06 22:45:55.929133 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 217/437] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:55 2022] GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 => generated 1144 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:56.851177 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6e3d9c2d-5d26-426a-aacc-88440e99de1a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:56.851938 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-6e3d9c2d-5d26-426a-aacc-88440e99de1a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:56.861954 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6e3d9c2d-5d26-426a-aacc-88440e99de1a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:56.862851 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6e3d9c2d-5d26-426a-aacc-88440e99de1a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:56.863628 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6e3d9c2d-5d26-426a-aacc-88440e99de1a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:56.864481 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6e3d9c2d-5d26-426a-aacc-88440e99de1a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:56.865080 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6e3d9c2d-5d26-426a-aacc-88440e99de1a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:56.865770 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6e3d9c2d-5d26-426a-aacc-88440e99de1a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:56.951272 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c8944140-ed72-4fe3-b03a-5669cfd54036 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:56.952049 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c8944140-ed72-4fe3-b03a-5669cfd54036 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:56.960680 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c8944140-ed72-4fe3-b03a-5669cfd54036 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:56.965107 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c8944140-ed72-4fe3-b03a-5669cfd54036 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:56.966085 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c8944140-ed72-4fe3-b03a-5669cfd54036 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:56.967096 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c8944140-ed72-4fe3-b03a-5669cfd54036 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:56.967558 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c8944140-ed72-4fe3-b03a-5669cfd54036 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:56.968614 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c8944140-ed72-4fe3-b03a-5669cfd54036 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:57.092729 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c8944140-ed72-4fe3-b03a-5669cfd54036 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:57.104560 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c8944140-ed72-4fe3-b03a-5669cfd54036 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126" status: 200 len: 1144 microversion: 2.1 time: 0.157081 Sep 06 22:45:57.114226 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6e3d9c2d-5d26-426a-aacc-88440e99de1a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:57.117365 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 218/438] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:56 2022] GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 => generated 1144 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:45:57.127469 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6e3d9c2d-5d26-426a-aacc-88440e99de1a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:57.129154 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6e3d9c2d-5d26-426a-aacc-88440e99de1a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:57.133704 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-6e3d9c2d-5d26-426a-aacc-88440e99de1a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1808 microversion: 2.20 time: 0.286183 Sep 06 22:45:57.134390 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 221/439] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:56 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1808 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:45:58.129331 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-cda56852-da7a-46f7-88fd-731cd9cfd974 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:58.130553 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-cda56852-da7a-46f7-88fd-731cd9cfd974 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:58.137951 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cda56852-da7a-46f7-88fd-731cd9cfd974 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:58.138447 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cda56852-da7a-46f7-88fd-731cd9cfd974 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:58.138879 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cda56852-da7a-46f7-88fd-731cd9cfd974 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:58.140586 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cda56852-da7a-46f7-88fd-731cd9cfd974 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:58.141314 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cda56852-da7a-46f7-88fd-731cd9cfd974 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:58.141743 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cda56852-da7a-46f7-88fd-731cd9cfd974 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:58.163614 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-2699eeff-a016-4c36-a768-91402c61be14 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:58.165178 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-2699eeff-a016-4c36-a768-91402c61be14 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:58.177494 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2699eeff-a016-4c36-a768-91402c61be14 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:58.178419 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2699eeff-a016-4c36-a768-91402c61be14 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:58.179007 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2699eeff-a016-4c36-a768-91402c61be14 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:58.180010 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2699eeff-a016-4c36-a768-91402c61be14 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:58.180607 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2699eeff-a016-4c36-a768-91402c61be14 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:58.181218 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2699eeff-a016-4c36-a768-91402c61be14 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:58.236293 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-cda56852-da7a-46f7-88fd-731cd9cfd974 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:58.245217 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-cda56852-da7a-46f7-88fd-731cd9cfd974 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126" status: 200 len: 1144 microversion: 2.1 time: 0.119830 Sep 06 22:45:58.266715 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 219/440] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:58 2022] GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 => generated 1144 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:58.373034 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-2699eeff-a016-4c36-a768-91402c61be14 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:58.382447 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-2699eeff-a016-4c36-a768-91402c61be14 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:58.383885 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-2699eeff-a016-4c36-a768-91402c61be14 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:58.385131 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-2699eeff-a016-4c36-a768-91402c61be14 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1808 microversion: 2.20 time: 0.226732 Sep 06 22:45:58.385675 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 222/441] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:58 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1808 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:45:59.273792 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-09ee21b9-33eb-4c89-af7c-9e25c8824c43 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:59.274499 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-09ee21b9-33eb-4c89-af7c-9e25c8824c43 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:59.281630 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-09ee21b9-33eb-4c89-af7c-9e25c8824c43 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:59.282217 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-09ee21b9-33eb-4c89-af7c-9e25c8824c43 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:59.282712 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-09ee21b9-33eb-4c89-af7c-9e25c8824c43 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:59.283472 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-09ee21b9-33eb-4c89-af7c-9e25c8824c43 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:59.284134 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-09ee21b9-33eb-4c89-af7c-9e25c8824c43 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:59.284620 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-09ee21b9-33eb-4c89-af7c-9e25c8824c43 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:59.362497 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-09ee21b9-33eb-4c89-af7c-9e25c8824c43 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:59.370503 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-09ee21b9-33eb-4c89-af7c-9e25c8824c43 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126" status: 200 len: 1144 microversion: 2.1 time: 0.100820 Sep 06 22:45:59.371063 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 220/442] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:45:59 2022] GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 => generated 1144 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:45:59.412483 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ebed3185-7e38-4189-bd64-513bfc699b4d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:45:59.413335 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ebed3185-7e38-4189-bd64-513bfc699b4d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:45:59.419560 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ebed3185-7e38-4189-bd64-513bfc699b4d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:59.420122 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ebed3185-7e38-4189-bd64-513bfc699b4d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:59.420610 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ebed3185-7e38-4189-bd64-513bfc699b4d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:59.422113 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ebed3185-7e38-4189-bd64-513bfc699b4d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:45:59.422623 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ebed3185-7e38-4189-bd64-513bfc699b4d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:45:59.423099 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ebed3185-7e38-4189-bd64-513bfc699b4d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:45:59.844630 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ebed3185-7e38-4189-bd64-513bfc699b4d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:59.853044 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ebed3185-7e38-4189-bd64-513bfc699b4d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:59.854474 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ebed3185-7e38-4189-bd64-513bfc699b4d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:45:59.855591 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ebed3185-7e38-4189-bd64-513bfc699b4d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1808 microversion: 2.20 time: 0.447495 Sep 06 22:45:59.856134 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 223/443] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:45:59 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1808 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:46:00.396122 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d70e4ccf-a178-4566-af31-c7c86e7a73b1 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:00.397011 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d70e4ccf-a178-4566-af31-c7c86e7a73b1 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:00.403344 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d70e4ccf-a178-4566-af31-c7c86e7a73b1 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:00.403826 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d70e4ccf-a178-4566-af31-c7c86e7a73b1 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:00.404254 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d70e4ccf-a178-4566-af31-c7c86e7a73b1 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:00.404966 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d70e4ccf-a178-4566-af31-c7c86e7a73b1 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:00.405412 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d70e4ccf-a178-4566-af31-c7c86e7a73b1 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:00.405832 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d70e4ccf-a178-4566-af31-c7c86e7a73b1 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:00.467763 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d70e4ccf-a178-4566-af31-c7c86e7a73b1 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:00.476805 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d70e4ccf-a178-4566-af31-c7c86e7a73b1 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126" status: 200 len: 1144 microversion: 2.1 time: 0.084643 Sep 06 22:46:00.477376 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 221/444] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:00 2022] GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:00.882488 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a713496b-71cc-497e-83c0-e14cafb640fd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:00.883154 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-a713496b-71cc-497e-83c0-e14cafb640fd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:00.903393 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a713496b-71cc-497e-83c0-e14cafb640fd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:00.903393 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a713496b-71cc-497e-83c0-e14cafb640fd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:00.903393 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a713496b-71cc-497e-83c0-e14cafb640fd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:00.903393 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a713496b-71cc-497e-83c0-e14cafb640fd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:00.903856 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a713496b-71cc-497e-83c0-e14cafb640fd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:00.903856 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a713496b-71cc-497e-83c0-e14cafb640fd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:00.966468 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4f6c4d37-26d3-4a7b-98af-9e23f0c919a1 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1079776361", "imageRef": "93326d5e-4826-431e-9ad1-6ee2d44e48d9", "flavorRef": "452", "networks": [{"uuid": "551795b5-57c5-49e5-b362-817642010952"}]}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:46:01.082834 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-a713496b-71cc-497e-83c0-e14cafb640fd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:01.093235 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-a713496b-71cc-497e-83c0-e14cafb640fd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:01.096060 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-a713496b-71cc-497e-83c0-e14cafb640fd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:01.097534 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-a713496b-71cc-497e-83c0-e14cafb640fd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1808 microversion: 2.20 time: 0.219526 Sep 06 22:46:01.098673 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 224/445] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:46:00 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:46:01.499595 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ab002bb0-f4b8-4cb2-8070-9bfac8677a4f tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:01.500174 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ab002bb0-f4b8-4cb2-8070-9bfac8677a4f tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:01.506458 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ab002bb0-f4b8-4cb2-8070-9bfac8677a4f tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:01.506942 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ab002bb0-f4b8-4cb2-8070-9bfac8677a4f tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:01.507373 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ab002bb0-f4b8-4cb2-8070-9bfac8677a4f tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:01.508067 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ab002bb0-f4b8-4cb2-8070-9bfac8677a4f tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:01.508516 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ab002bb0-f4b8-4cb2-8070-9bfac8677a4f tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:01.508969 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ab002bb0-f4b8-4cb2-8070-9bfac8677a4f tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:01.574319 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ab002bb0-f4b8-4cb2-8070-9bfac8677a4f tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:01.583248 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ab002bb0-f4b8-4cb2-8070-9bfac8677a4f tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126" status: 200 len: 1144 microversion: 2.1 time: 0.087912 Sep 06 22:46:01.583823 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 225/446] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:01 2022] GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:46:02.123622 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-38aa5a0e-52f0-4360-96f4-39fbe5006807 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:02.124456 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-38aa5a0e-52f0-4360-96f4-39fbe5006807 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:02.126807 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=2 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:46:02.127538 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=6 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:46:02.132698 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-38aa5a0e-52f0-4360-96f4-39fbe5006807 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:02.133298 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-38aa5a0e-52f0-4360-96f4-39fbe5006807 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:02.133794 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-38aa5a0e-52f0-4360-96f4-39fbe5006807 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:02.134963 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-38aa5a0e-52f0-4360-96f4-39fbe5006807 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:02.135466 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-38aa5a0e-52f0-4360-96f4-39fbe5006807 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:02.135789 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-38aa5a0e-52f0-4360-96f4-39fbe5006807 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:02.279855 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-38aa5a0e-52f0-4360-96f4-39fbe5006807 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:02.289879 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-38aa5a0e-52f0-4360-96f4-39fbe5006807 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:02.291413 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-38aa5a0e-52f0-4360-96f4-39fbe5006807 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:02.292631 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-38aa5a0e-52f0-4360-96f4-39fbe5006807 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1808 microversion: 2.20 time: 0.172985 Sep 06 22:46:02.293305 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 226/447] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:46:02 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 22:46:02.574232 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=6 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:46:02.606800 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9eafb20a-37da-4dfb-8036-30273de00217 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:02.607406 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9eafb20a-37da-4dfb-8036-30273de00217 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:02.614431 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9eafb20a-37da-4dfb-8036-30273de00217 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:02.615003 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9eafb20a-37da-4dfb-8036-30273de00217 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:02.615507 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9eafb20a-37da-4dfb-8036-30273de00217 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:02.616311 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9eafb20a-37da-4dfb-8036-30273de00217 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:02.616780 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9eafb20a-37da-4dfb-8036-30273de00217 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:02.617200 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9eafb20a-37da-4dfb-8036-30273de00217 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:02.685725 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9eafb20a-37da-4dfb-8036-30273de00217 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:02.694302 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9eafb20a-37da-4dfb-8036-30273de00217 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126" status: 200 len: 1144 microversion: 2.1 time: 0.091282 Sep 06 22:46:02.695067 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 227/448] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:02 2022] GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 => generated 1144 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:46:03.319508 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-3d0919ed-1b1e-476d-902f-51cd4431b52c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:03.320188 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-3d0919ed-1b1e-476d-902f-51cd4431b52c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:03.325987 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3d0919ed-1b1e-476d-902f-51cd4431b52c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:03.326463 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3d0919ed-1b1e-476d-902f-51cd4431b52c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:03.326881 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3d0919ed-1b1e-476d-902f-51cd4431b52c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:03.327558 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3d0919ed-1b1e-476d-902f-51cd4431b52c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:03.327999 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3d0919ed-1b1e-476d-902f-51cd4431b52c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:03.329037 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3d0919ed-1b1e-476d-902f-51cd4431b52c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:03.472842 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3d0919ed-1b1e-476d-902f-51cd4431b52c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:03.481510 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3d0919ed-1b1e-476d-902f-51cd4431b52c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:03.482962 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3d0919ed-1b1e-476d-902f-51cd4431b52c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:03.484106 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-3d0919ed-1b1e-476d-902f-51cd4431b52c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1808 microversion: 2.20 time: 0.168581 Sep 06 22:46:03.485895 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 228/449] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:46:03 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 22:46:03.718261 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-70c22108-038a-47c6-a6a0-c6c30d2fb671 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:03.719339 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-70c22108-038a-47c6-a6a0-c6c30d2fb671 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:03.725641 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-70c22108-038a-47c6-a6a0-c6c30d2fb671 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:03.726189 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-70c22108-038a-47c6-a6a0-c6c30d2fb671 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:03.726618 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-70c22108-038a-47c6-a6a0-c6c30d2fb671 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:03.727477 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-70c22108-038a-47c6-a6a0-c6c30d2fb671 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:03.728073 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-70c22108-038a-47c6-a6a0-c6c30d2fb671 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:03.728563 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-70c22108-038a-47c6-a6a0-c6c30d2fb671 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:03.801876 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-70c22108-038a-47c6-a6a0-c6c30d2fb671 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:03.810149 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-70c22108-038a-47c6-a6a0-c6c30d2fb671 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126" status: 200 len: 1144 microversion: 2.1 time: 0.095738 Sep 06 22:46:03.810721 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 229/450] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:03 2022] GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 => generated 1144 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:46:04.513012 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-c2de0154-13c1-412c-9636-88bc5171439b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:04.513012 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-c2de0154-13c1-412c-9636-88bc5171439b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:04.518317 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c2de0154-13c1-412c-9636-88bc5171439b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:04.518801 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c2de0154-13c1-412c-9636-88bc5171439b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:04.519248 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c2de0154-13c1-412c-9636-88bc5171439b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:04.519969 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c2de0154-13c1-412c-9636-88bc5171439b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:04.520502 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c2de0154-13c1-412c-9636-88bc5171439b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:04.520988 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c2de0154-13c1-412c-9636-88bc5171439b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:04.526741 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.network.neutron [None req-4f6c4d37-26d3-4a7b-98af-9e23f0c919a1 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] validate_networks() for [('551795b5-57c5-49e5-b362-817642010952', None, None, None, None, None)] {{(pid=127088) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 22:46:04.730806 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-c2de0154-13c1-412c-9636-88bc5171439b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:04.739906 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-c2de0154-13c1-412c-9636-88bc5171439b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:04.743548 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-c2de0154-13c1-412c-9636-88bc5171439b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:04.743548 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-c2de0154-13c1-412c-9636-88bc5171439b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1808 microversion: 2.20 time: 0.235178 Sep 06 22:46:04.743548 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 230/451] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:46:04 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1808 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 22:46:04.833545 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-633c9084-396f-4dd9-819c-a59c9cc1191e tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:04.835708 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-633c9084-396f-4dd9-819c-a59c9cc1191e tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:04.842262 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-633c9084-396f-4dd9-819c-a59c9cc1191e tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:04.842759 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-633c9084-396f-4dd9-819c-a59c9cc1191e tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:04.843335 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-633c9084-396f-4dd9-819c-a59c9cc1191e tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:04.844001 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-633c9084-396f-4dd9-819c-a59c9cc1191e tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:04.845077 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-633c9084-396f-4dd9-819c-a59c9cc1191e tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:04.845795 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-633c9084-396f-4dd9-819c-a59c9cc1191e tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:04.948885 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-633c9084-396f-4dd9-819c-a59c9cc1191e tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:04.957844 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-633c9084-396f-4dd9-819c-a59c9cc1191e tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126" status: 200 len: 1144 microversion: 2.1 time: 0.127916 Sep 06 22:46:04.958272 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 231/452] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:04 2022] GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 => generated 1144 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:46:04.991967 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-4f6c4d37-26d3-4a7b-98af-9e23f0c919a1 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Flavor limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 22:46:04.992379 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-4f6c4d37-26d3-4a7b-98af-9e23f0c919a1 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Image limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 22:46:04.992868 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-4f6c4d37-26d3-4a7b-98af-9e23f0c919a1 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Flavor pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 22:46:04.993280 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-4f6c4d37-26d3-4a7b-98af-9e23f0c919a1 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Image pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 22:46:04.993671 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-4f6c4d37-26d3-4a7b-98af-9e23f0c919a1 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 22:46:05.004100 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4f6c4d37-26d3-4a7b-98af-9e23f0c919a1 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:05.004574 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4f6c4d37-26d3-4a7b-98af-9e23f0c919a1 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:05.005027 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4f6c4d37-26d3-4a7b-98af-9e23f0c919a1 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:05.005745 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4f6c4d37-26d3-4a7b-98af-9e23f0c919a1 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:05.006185 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4f6c4d37-26d3-4a7b-98af-9e23f0c919a1 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:05.006598 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4f6c4d37-26d3-4a7b-98af-9e23f0c919a1 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:05.024120 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-4f6c4d37-26d3-4a7b-98af-9e23f0c919a1 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Getting quotas for project 3ebbea5186774c59942358c1fc284fa7. Resources: {'instances', 'ram', 'cores'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 22:46:05.028067 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-4f6c4d37-26d3-4a7b-98af-9e23f0c919a1 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Getting quotas for user 81d8036279ef4384bdbfa8c37e46a1d6 and project 3ebbea5186774c59942358c1fc284fa7. Resources: {'instances', 'ram', 'cores'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 22:46:05.039264 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4f6c4d37-26d3-4a7b-98af-9e23f0c919a1 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Going to run 1 instances... {{(pid=127088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 22:46:05.041908 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4f6c4d37-26d3-4a7b-98af-9e23f0c919a1 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c396f306-9184-4575-9c97-3b0ef86a7d3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='93326d5e-4826-431e-9ad1-6ee2d44e48d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 22:46:05.095504 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4f6c4d37-26d3-4a7b-98af-9e23f0c919a1 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.133578 Sep 06 22:46:05.096395 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 222/453] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Sep 6 22:46:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 4135 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 22:46:05.109228 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-23d0d0f1-986d-403b-a96c-da8379fd59b0 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:05.110276 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-23d0d0f1-986d-403b-a96c-da8379fd59b0 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c396f306-9184-4575-9c97-3b0ef86a7d3d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:05.165074 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-23d0d0f1-986d-403b-a96c-da8379fd59b0 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8036279ef4384bdbfa8c37e46a1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebbea5186774c59942358c1fc284fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:05.172140 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-23d0d0f1-986d-403b-a96c-da8379fd59b0 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d" status: 200 len: 1219 microversion: 2.1 time: 0.066676 Sep 06 22:46:05.172864 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 232/454] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:05 2022] GET /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:05.767908 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b7a9faa1-7707-4a20-ae72-a9a8b25c7a8d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:05.768499 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b7a9faa1-7707-4a20-ae72-a9a8b25c7a8d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:05.775292 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b7a9faa1-7707-4a20-ae72-a9a8b25c7a8d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:05.775767 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b7a9faa1-7707-4a20-ae72-a9a8b25c7a8d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:05.776193 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b7a9faa1-7707-4a20-ae72-a9a8b25c7a8d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:05.776896 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b7a9faa1-7707-4a20-ae72-a9a8b25c7a8d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:05.777340 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b7a9faa1-7707-4a20-ae72-a9a8b25c7a8d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:05.777754 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b7a9faa1-7707-4a20-ae72-a9a8b25c7a8d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:05.912836 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b7a9faa1-7707-4a20-ae72-a9a8b25c7a8d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:05.921462 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b7a9faa1-7707-4a20-ae72-a9a8b25c7a8d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:05.923880 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b7a9faa1-7707-4a20-ae72-a9a8b25c7a8d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:05.925082 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b7a9faa1-7707-4a20-ae72-a9a8b25c7a8d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1808 microversion: 2.20 time: 0.161605 Sep 06 22:46:05.925630 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 223/455] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:46:05 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:46:05.980455 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d81ef80e-4483-42c9-b1bc-03d89a26e0a6 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:05.981017 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-d81ef80e-4483-42c9-b1bc-03d89a26e0a6 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:05.987621 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d81ef80e-4483-42c9-b1bc-03d89a26e0a6 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:05.988100 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d81ef80e-4483-42c9-b1bc-03d89a26e0a6 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:05.988528 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d81ef80e-4483-42c9-b1bc-03d89a26e0a6 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:05.989243 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d81ef80e-4483-42c9-b1bc-03d89a26e0a6 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:05.989689 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d81ef80e-4483-42c9-b1bc-03d89a26e0a6 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:05.990106 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d81ef80e-4483-42c9-b1bc-03d89a26e0a6 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:06.051866 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-d81ef80e-4483-42c9-b1bc-03d89a26e0a6 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:06.060117 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d81ef80e-4483-42c9-b1bc-03d89a26e0a6 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126" status: 200 len: 1192 microversion: 2.1 time: 0.083537 Sep 06 22:46:06.060681 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 233/456] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:05 2022] GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 => generated 1192 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:06.211087 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e92bd7ec-d9dc-47cc-8510-13c1b5a10be9 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:06.211886 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e92bd7ec-d9dc-47cc-8510-13c1b5a10be9 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c396f306-9184-4575-9c97-3b0ef86a7d3d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:06.219160 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e92bd7ec-d9dc-47cc-8510-13c1b5a10be9 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:06.219824 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e92bd7ec-d9dc-47cc-8510-13c1b5a10be9 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:06.220292 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e92bd7ec-d9dc-47cc-8510-13c1b5a10be9 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:06.221497 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e92bd7ec-d9dc-47cc-8510-13c1b5a10be9 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:06.222036 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e92bd7ec-d9dc-47cc-8510-13c1b5a10be9 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:06.222370 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e92bd7ec-d9dc-47cc-8510-13c1b5a10be9 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:06.303569 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e92bd7ec-d9dc-47cc-8510-13c1b5a10be9 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8036279ef4384bdbfa8c37e46a1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebbea5186774c59942358c1fc284fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:06.313558 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e92bd7ec-d9dc-47cc-8510-13c1b5a10be9 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d" status: 200 len: 1271 microversion: 2.1 time: 0.106560 Sep 06 22:46:06.314363 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 224/457] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:06 2022] GET /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d => generated 1271 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:46:06.951646 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-bdf5fca8-cd4d-491a-8036-9df76b7abf1c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:06.952330 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-bdf5fca8-cd4d-491a-8036-9df76b7abf1c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:06.960056 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bdf5fca8-cd4d-491a-8036-9df76b7abf1c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:06.960727 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bdf5fca8-cd4d-491a-8036-9df76b7abf1c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:06.961476 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bdf5fca8-cd4d-491a-8036-9df76b7abf1c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:06.962412 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bdf5fca8-cd4d-491a-8036-9df76b7abf1c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:06.962867 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bdf5fca8-cd4d-491a-8036-9df76b7abf1c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:06.963282 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bdf5fca8-cd4d-491a-8036-9df76b7abf1c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:07.086420 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8d2a006a-1351-4b17-ba8a-0260e2ac9d7b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:07.087684 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8d2a006a-1351-4b17-ba8a-0260e2ac9d7b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:07.096990 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d2a006a-1351-4b17-ba8a-0260e2ac9d7b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:07.097792 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d2a006a-1351-4b17-ba8a-0260e2ac9d7b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:07.098539 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d2a006a-1351-4b17-ba8a-0260e2ac9d7b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:07.099762 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d2a006a-1351-4b17-ba8a-0260e2ac9d7b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:07.100366 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d2a006a-1351-4b17-ba8a-0260e2ac9d7b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:07.101014 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d2a006a-1351-4b17-ba8a-0260e2ac9d7b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:07.301368 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-bdf5fca8-cd4d-491a-8036-9df76b7abf1c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:07.312214 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-bdf5fca8-cd4d-491a-8036-9df76b7abf1c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:07.314671 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-bdf5fca8-cd4d-491a-8036-9df76b7abf1c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:07.315830 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-bdf5fca8-cd4d-491a-8036-9df76b7abf1c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1808 microversion: 2.20 time: 0.369237 Sep 06 22:46:07.316546 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 234/458] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:46:06 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1808 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:46:07.337700 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-8b59d05a-8f6e-444f-9fb2-e71d639b2002 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:07.338336 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-8b59d05a-8f6e-444f-9fb2-e71d639b2002 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c396f306-9184-4575-9c97-3b0ef86a7d3d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:07.344810 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8b59d05a-8f6e-444f-9fb2-e71d639b2002 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:07.345537 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8b59d05a-8f6e-444f-9fb2-e71d639b2002 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:07.345997 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8b59d05a-8f6e-444f-9fb2-e71d639b2002 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:07.346694 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8b59d05a-8f6e-444f-9fb2-e71d639b2002 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:07.347135 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8b59d05a-8f6e-444f-9fb2-e71d639b2002 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:07.347558 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8b59d05a-8f6e-444f-9fb2-e71d639b2002 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:07.452592 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8d2a006a-1351-4b17-ba8a-0260e2ac9d7b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:07.454949 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-8b59d05a-8f6e-444f-9fb2-e71d639b2002 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8036279ef4384bdbfa8c37e46a1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebbea5186774c59942358c1fc284fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:07.462258 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8d2a006a-1351-4b17-ba8a-0260e2ac9d7b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126" status: 200 len: 1278 microversion: 2.1 time: 0.382241 Sep 06 22:46:07.463095 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 225/459] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:07 2022] GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 => generated 1278 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:07.472947 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-8b59d05a-8f6e-444f-9fb2-e71d639b2002 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d" status: 200 len: 1277 microversion: 2.1 time: 0.130058 Sep 06 22:46:07.472947 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 235/460] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:07 2022] GET /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d => generated 1277 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:46:08.342631 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-319e0c0e-2389-4438-9775-00c3c779d3ff tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:08.343215 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-319e0c0e-2389-4438-9775-00c3c779d3ff tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:08.351918 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-319e0c0e-2389-4438-9775-00c3c779d3ff tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:08.352631 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-319e0c0e-2389-4438-9775-00c3c779d3ff tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:08.353149 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-319e0c0e-2389-4438-9775-00c3c779d3ff tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:08.353925 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-319e0c0e-2389-4438-9775-00c3c779d3ff tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:08.354416 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-319e0c0e-2389-4438-9775-00c3c779d3ff tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:08.354831 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-319e0c0e-2389-4438-9775-00c3c779d3ff tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:08.486129 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8db38fbf-25fa-4299-9595-90ed9a8b558b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:08.486736 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8db38fbf-25fa-4299-9595-90ed9a8b558b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:08.493220 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8db38fbf-25fa-4299-9595-90ed9a8b558b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:08.493710 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8db38fbf-25fa-4299-9595-90ed9a8b558b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:08.494151 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8db38fbf-25fa-4299-9595-90ed9a8b558b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:08.494848 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8db38fbf-25fa-4299-9595-90ed9a8b558b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:08.495292 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8db38fbf-25fa-4299-9595-90ed9a8b558b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:08.495709 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8db38fbf-25fa-4299-9595-90ed9a8b558b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:08.782715 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-319e0c0e-2389-4438-9775-00c3c779d3ff tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:08.791676 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-319e0c0e-2389-4438-9775-00c3c779d3ff tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:08.793237 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-319e0c0e-2389-4438-9775-00c3c779d3ff tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:08.794464 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-319e0c0e-2389-4438-9775-00c3c779d3ff tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1808 microversion: 2.20 time: 0.456531 Sep 06 22:46:08.795098 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 236/461] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:46:08 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1808 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:46:08.799616 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-3740579c-d336-4349-8651-e98e1b83ee22 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:08.800213 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-3740579c-d336-4349-8651-e98e1b83ee22 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c396f306-9184-4575-9c97-3b0ef86a7d3d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:08.806132 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3740579c-d336-4349-8651-e98e1b83ee22 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:08.806604 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3740579c-d336-4349-8651-e98e1b83ee22 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:08.807031 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3740579c-d336-4349-8651-e98e1b83ee22 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:08.808008 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3740579c-d336-4349-8651-e98e1b83ee22 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:08.808481 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3740579c-d336-4349-8651-e98e1b83ee22 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:08.808978 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3740579c-d336-4349-8651-e98e1b83ee22 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:09.180283 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8db38fbf-25fa-4299-9595-90ed9a8b558b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:09.188562 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8db38fbf-25fa-4299-9595-90ed9a8b558b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126" status: 200 len: 1266 microversion: 2.1 time: 0.705969 Sep 06 22:46:09.189169 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 226/462] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:08 2022] GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 => generated 1266 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:09.200703 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-1accb9ad-f984-4018-ba7b-486711c136a9 req-23c151c3-e815-4145-9061-a1818ad257bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7930b2ec-9579-46df-a554-d9b9ba019126", "tag": "a641f658-6203-4321-afb0-71036d26ddf5"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:46:09.205469 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-1accb9ad-f984-4018-ba7b-486711c136a9 req-23c151c3-e815-4145-9061-a1818ad257bd service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:09.206037 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-1accb9ad-f984-4018-ba7b-486711c136a9 req-23c151c3-e815-4145-9061-a1818ad257bd service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:09.206458 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-1accb9ad-f984-4018-ba7b-486711c136a9 req-23c151c3-e815-4145-9061-a1818ad257bd service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:09.219178 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-1accb9ad-f984-4018-ba7b-486711c136a9 req-23c151c3-e815-4145-9061-a1818ad257bd service nova] Creating event network-changed:a641f658-6203-4321-afb0-71036d26ddf5 for instance 7930b2ec-9579-46df-a554-d9b9ba019126 on hv-cinder-85220 Sep 06 22:46:09.224485 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-1accb9ad-f984-4018-ba7b-486711c136a9 req-23c151c3-e815-4145-9061-a1818ad257bd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034192 Sep 06 22:46:09.227378 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 227/463] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:46:09.402705 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3740579c-d336-4349-8651-e98e1b83ee22 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8036279ef4384bdbfa8c37e46a1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebbea5186774c59942358c1fc284fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:09.405081 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=100 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:46:09.412471 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-3740579c-d336-4349-8651-e98e1b83ee22 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d" status: 200 len: 1319 microversion: 2.1 time: 0.616348 Sep 06 22:46:09.413375 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 237/464] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:08 2022] GET /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d => generated 1319 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:09.821673 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5e9b6a70-4f16-4740-bcd6-8aabd854180b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:09.822445 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5e9b6a70-4f16-4740-bcd6-8aabd854180b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:09.829162 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e9b6a70-4f16-4740-bcd6-8aabd854180b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:09.829648 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e9b6a70-4f16-4740-bcd6-8aabd854180b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:09.830084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e9b6a70-4f16-4740-bcd6-8aabd854180b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:09.830780 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e9b6a70-4f16-4740-bcd6-8aabd854180b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:09.831232 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e9b6a70-4f16-4740-bcd6-8aabd854180b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:09.831651 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5e9b6a70-4f16-4740-bcd6-8aabd854180b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:09.966640 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5e9b6a70-4f16-4740-bcd6-8aabd854180b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:09.975713 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5e9b6a70-4f16-4740-bcd6-8aabd854180b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:09.977185 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5e9b6a70-4f16-4740-bcd6-8aabd854180b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:09.978333 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5e9b6a70-4f16-4740-bcd6-8aabd854180b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1808 microversion: 2.20 time: 0.160966 Sep 06 22:46:09.978921 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 228/465] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:46:09 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 22:46:10.211604 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e69d79dc-dce1-4e81-b7f0-291fdfea7071 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:10.212233 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e69d79dc-dce1-4e81-b7f0-291fdfea7071 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:10.218179 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e69d79dc-dce1-4e81-b7f0-291fdfea7071 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:10.218661 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e69d79dc-dce1-4e81-b7f0-291fdfea7071 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:10.219694 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e69d79dc-dce1-4e81-b7f0-291fdfea7071 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:10.220390 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e69d79dc-dce1-4e81-b7f0-291fdfea7071 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:10.220863 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e69d79dc-dce1-4e81-b7f0-291fdfea7071 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:10.221290 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e69d79dc-dce1-4e81-b7f0-291fdfea7071 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:10.436303 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8aaecd22-49ed-46d1-9d73-214b9174e50a tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:10.437040 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8aaecd22-49ed-46d1-9d73-214b9174e50a tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c396f306-9184-4575-9c97-3b0ef86a7d3d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:10.444803 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8aaecd22-49ed-46d1-9d73-214b9174e50a tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:10.445509 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8aaecd22-49ed-46d1-9d73-214b9174e50a tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:10.445941 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8aaecd22-49ed-46d1-9d73-214b9174e50a tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:10.446634 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8aaecd22-49ed-46d1-9d73-214b9174e50a tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:10.447085 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8aaecd22-49ed-46d1-9d73-214b9174e50a tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:10.447503 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8aaecd22-49ed-46d1-9d73-214b9174e50a tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:10.451798 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e69d79dc-dce1-4e81-b7f0-291fdfea7071 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:10.460573 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e69d79dc-dce1-4e81-b7f0-291fdfea7071 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126" status: 200 len: 1266 microversion: 2.1 time: 0.252961 Sep 06 22:46:10.461245 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 238/466] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:10 2022] GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:10.688454 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8aaecd22-49ed-46d1-9d73-214b9174e50a tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8036279ef4384bdbfa8c37e46a1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebbea5186774c59942358c1fc284fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:10.696525 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8aaecd22-49ed-46d1-9d73-214b9174e50a tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d" status: 200 len: 1319 microversion: 2.1 time: 0.264580 Sep 06 22:46:10.697118 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 229/467] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:10 2022] GET /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:46:11.003975 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-95d4428a-16e8-4659-b711-eeeaf3360c84 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:11.004577 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-95d4428a-16e8-4659-b711-eeeaf3360c84 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:11.010486 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-95d4428a-16e8-4659-b711-eeeaf3360c84 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:11.010961 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-95d4428a-16e8-4659-b711-eeeaf3360c84 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:11.011383 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-95d4428a-16e8-4659-b711-eeeaf3360c84 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:11.012090 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-95d4428a-16e8-4659-b711-eeeaf3360c84 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:11.012536 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-95d4428a-16e8-4659-b711-eeeaf3360c84 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:11.012981 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-95d4428a-16e8-4659-b711-eeeaf3360c84 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:11.150310 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-95d4428a-16e8-4659-b711-eeeaf3360c84 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:11.159249 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-95d4428a-16e8-4659-b711-eeeaf3360c84 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:11.160687 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-95d4428a-16e8-4659-b711-eeeaf3360c84 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:11.161844 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-95d4428a-16e8-4659-b711-eeeaf3360c84 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1808 microversion: 2.20 time: 0.162340 Sep 06 22:46:11.162389 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 239/468] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:46:10 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:46:11.256684 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-96192325-2d77-4bda-8e1e-3dd84cee08c6 req-ac267be9-71f9-4899-9730-0dd59901eb8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c396f306-9184-4575-9c97-3b0ef86a7d3d", "tag": "75bdd4fe-9e1c-43fe-b117-ea174c811267"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:46:11.267482 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-96192325-2d77-4bda-8e1e-3dd84cee08c6 req-ac267be9-71f9-4899-9730-0dd59901eb8f service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:11.267960 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-96192325-2d77-4bda-8e1e-3dd84cee08c6 req-ac267be9-71f9-4899-9730-0dd59901eb8f service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:11.268390 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-96192325-2d77-4bda-8e1e-3dd84cee08c6 req-ac267be9-71f9-4899-9730-0dd59901eb8f service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:11.279773 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-96192325-2d77-4bda-8e1e-3dd84cee08c6 req-ac267be9-71f9-4899-9730-0dd59901eb8f service nova] Creating event network-changed:75bdd4fe-9e1c-43fe-b117-ea174c811267 for instance c396f306-9184-4575-9c97-3b0ef86a7d3d on hv-cinder-85220 Sep 06 22:46:11.284630 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-96192325-2d77-4bda-8e1e-3dd84cee08c6 req-ac267be9-71f9-4899-9730-0dd59901eb8f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031605 Sep 06 22:46:11.285293 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 230/469] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:46:11.496266 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-5e3c1164-bf44-49e0-bbb9-d65c881ae4fb tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:11.496266 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-5e3c1164-bf44-49e0-bbb9-d65c881ae4fb tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:11.496266 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e3c1164-bf44-49e0-bbb9-d65c881ae4fb tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:11.496266 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e3c1164-bf44-49e0-bbb9-d65c881ae4fb tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:11.497552 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e3c1164-bf44-49e0-bbb9-d65c881ae4fb tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:11.497552 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e3c1164-bf44-49e0-bbb9-d65c881ae4fb tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:11.497552 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e3c1164-bf44-49e0-bbb9-d65c881ae4fb tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:11.497552 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e3c1164-bf44-49e0-bbb9-d65c881ae4fb tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:11.506035 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9f8a53c0-559c-4054-bc8a-68939c0aced3 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1480684418", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1356466728", "security_groups": [{"name": "tempest-secgroup-smoke-453652813"}], "networks": [{"uuid": "7a61ff4c-ff02-4bee-9837-70000779e8ea"}], "block_device_mapping_v2": [{"uuid": "3f681a95-d3fd-4884-85f8-ec2666dc65eb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:46:11.704536 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.network.neutron [None req-9f8a53c0-559c-4054-bc8a-68939c0aced3 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] validate_networks() for [('7a61ff4c-ff02-4bee-9837-70000779e8ea', None, None, None, None, None)] {{(pid=127088) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 22:46:11.788141 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-5e3c1164-bf44-49e0-bbb9-d65c881ae4fb tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:11.795616 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-5e3c1164-bf44-49e0-bbb9-d65c881ae4fb tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126" status: 200 len: 1266 microversion: 2.1 time: 0.315781 Sep 06 22:46:11.796177 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 240/470] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:11 2022] GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 => generated 1266 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:11.800648 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-976b88f8-a992-4283-b38f-eee8f8a28344 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:11.801497 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-976b88f8-a992-4283-b38f-eee8f8a28344 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c396f306-9184-4575-9c97-3b0ef86a7d3d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:11.807031 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-976b88f8-a992-4283-b38f-eee8f8a28344 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:11.807503 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-976b88f8-a992-4283-b38f-eee8f8a28344 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:11.808096 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-976b88f8-a992-4283-b38f-eee8f8a28344 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:11.808850 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-976b88f8-a992-4283-b38f-eee8f8a28344 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:11.809453 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-976b88f8-a992-4283-b38f-eee8f8a28344 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:11.809869 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-976b88f8-a992-4283-b38f-eee8f8a28344 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:11.996350 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-976b88f8-a992-4283-b38f-eee8f8a28344 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8036279ef4384bdbfa8c37e46a1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebbea5186774c59942358c1fc284fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:12.004432 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-976b88f8-a992-4283-b38f-eee8f8a28344 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d" status: 200 len: 1319 microversion: 2.1 time: 0.207307 Sep 06 22:46:12.005031 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 241/471] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:11 2022] GET /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:12.158958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-9f8a53c0-559c-4054-bc8a-68939c0aced3 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Flavor limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 22:46:12.159381 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-9f8a53c0-559c-4054-bc8a-68939c0aced3 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Image limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 22:46:12.159852 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-9f8a53c0-559c-4054-bc8a-68939c0aced3 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Flavor pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 22:46:12.160252 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-9f8a53c0-559c-4054-bc8a-68939c0aced3 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Image pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 22:46:12.160687 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-9f8a53c0-559c-4054-bc8a-68939c0aced3 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 22:46:12.169446 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f8a53c0-559c-4054-bc8a-68939c0aced3 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:12.169925 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f8a53c0-559c-4054-bc8a-68939c0aced3 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:12.170351 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f8a53c0-559c-4054-bc8a-68939c0aced3 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:12.171080 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f8a53c0-559c-4054-bc8a-68939c0aced3 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:12.171528 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f8a53c0-559c-4054-bc8a-68939c0aced3 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:12.172496 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f8a53c0-559c-4054-bc8a-68939c0aced3 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:12.186601 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b559a78f-b76d-4e34-8a94-f435a38dbf6f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:12.187242 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b559a78f-b76d-4e34-8a94-f435a38dbf6f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:12.189794 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-9f8a53c0-559c-4054-bc8a-68939c0aced3 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Getting quotas for project 410f8fc9cc284ba78edf9f4db25f9d31. Resources: {'instances', 'ram', 'cores'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 22:46:12.193828 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-9f8a53c0-559c-4054-bc8a-68939c0aced3 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Getting quotas for user bcede7fa39dd47f7ba80c5add2c0f750 and project 410f8fc9cc284ba78edf9f4db25f9d31. Resources: {'instances', 'ram', 'cores'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 22:46:12.193971 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b559a78f-b76d-4e34-8a94-f435a38dbf6f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:12.194341 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b559a78f-b76d-4e34-8a94-f435a38dbf6f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:12.195006 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b559a78f-b76d-4e34-8a94-f435a38dbf6f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:12.195699 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b559a78f-b76d-4e34-8a94-f435a38dbf6f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:12.196146 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b559a78f-b76d-4e34-8a94-f435a38dbf6f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:12.196575 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b559a78f-b76d-4e34-8a94-f435a38dbf6f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:12.251325 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9f8a53c0-559c-4054-bc8a-68939c0aced3 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Going to run 1 instances... {{(pid=127088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 22:46:12.253592 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9f8a53c0-559c-4054-bc8a-68939c0aced3 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3f681a95-d3fd-4884-85f8-ec2666dc65eb',volume_size=None,volume_type=None)] {{(pid=127088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 22:46:12.325019 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 22:46:12.325248 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Tue Sep 6 22:46:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd (ip 10.222.0.39) !!! Sep 06 22:46:12.334676 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b559a78f-b76d-4e34-8a94-f435a38dbf6f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:12.351407 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b559a78f-b76d-4e34-8a94-f435a38dbf6f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:12.353024 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b559a78f-b76d-4e34-8a94-f435a38dbf6f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:12.354196 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b559a78f-b76d-4e34-8a94-f435a38dbf6f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1808 microversion: 2.20 time: 0.171432 Sep 06 22:46:12.354733 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 242/472] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:46:12 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 22:46:12.392743 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9f8a53c0-559c-4054-bc8a-68939c0aced3 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.891290 Sep 06 22:46:12.393438 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 231/473] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Sep 6 22:46:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 22:46:12.404652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-bc6c5a69-4a6d-47da-9f8c-a771c7228f4e tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:12.405208 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-bc6c5a69-4a6d-47da-9f8c-a771c7228f4e tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:12.459773 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-bc6c5a69-4a6d-47da-9f8c-a771c7228f4e tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:12.467133 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-bc6c5a69-4a6d-47da-9f8c-a771c7228f4e tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1089 microversion: 2.1 time: 0.066314 Sep 06 22:46:12.468266 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 243/474] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:12 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1089 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:12.819388 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8af729e2-089c-43cc-bfe5-b14882494f21 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:12.820157 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8af729e2-089c-43cc-bfe5-b14882494f21 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:12.827206 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8af729e2-089c-43cc-bfe5-b14882494f21 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:12.827727 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8af729e2-089c-43cc-bfe5-b14882494f21 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:12.828802 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8af729e2-089c-43cc-bfe5-b14882494f21 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:12.829905 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8af729e2-089c-43cc-bfe5-b14882494f21 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:12.830579 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8af729e2-089c-43cc-bfe5-b14882494f21 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:12.831708 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8af729e2-089c-43cc-bfe5-b14882494f21 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:13.028257 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-863869e8-5c3e-429b-ad39-3e72ada52e95 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:13.029589 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-863869e8-5c3e-429b-ad39-3e72ada52e95 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c396f306-9184-4575-9c97-3b0ef86a7d3d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:13.038894 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8af729e2-089c-43cc-bfe5-b14882494f21 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:13.039418 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-863869e8-5c3e-429b-ad39-3e72ada52e95 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:13.040190 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-863869e8-5c3e-429b-ad39-3e72ada52e95 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:13.040855 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-863869e8-5c3e-429b-ad39-3e72ada52e95 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:13.041819 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-863869e8-5c3e-429b-ad39-3e72ada52e95 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:13.042328 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-863869e8-5c3e-429b-ad39-3e72ada52e95 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:13.043230 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-863869e8-5c3e-429b-ad39-3e72ada52e95 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:13.054964 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8af729e2-089c-43cc-bfe5-b14882494f21 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126" status: 200 len: 1266 microversion: 2.1 time: 0.240107 Sep 06 22:46:13.056499 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 232/475] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:12 2022] GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:13.204580 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-863869e8-5c3e-429b-ad39-3e72ada52e95 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8036279ef4384bdbfa8c37e46a1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebbea5186774c59942358c1fc284fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:13.213634 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-863869e8-5c3e-429b-ad39-3e72ada52e95 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d" status: 200 len: 1319 microversion: 2.1 time: 0.189796 Sep 06 22:46:13.214192 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 244/476] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:13 2022] GET /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:13.379932 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b2a3151f-7bc2-485d-98ba-b8b8bc05aabe tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:13.380496 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b2a3151f-7bc2-485d-98ba-b8b8bc05aabe tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:13.386935 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b2a3151f-7bc2-485d-98ba-b8b8bc05aabe tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:13.387418 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b2a3151f-7bc2-485d-98ba-b8b8bc05aabe tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:13.387852 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b2a3151f-7bc2-485d-98ba-b8b8bc05aabe tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:13.388536 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b2a3151f-7bc2-485d-98ba-b8b8bc05aabe tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:13.389014 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b2a3151f-7bc2-485d-98ba-b8b8bc05aabe tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:13.389434 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b2a3151f-7bc2-485d-98ba-b8b8bc05aabe tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:13.492147 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-62c5d8f5-3a3b-47c8-8434-d5bcf47502b7 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:13.492776 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-62c5d8f5-3a3b-47c8-8434-d5bcf47502b7 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:13.498957 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-62c5d8f5-3a3b-47c8-8434-d5bcf47502b7 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:13.499447 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-62c5d8f5-3a3b-47c8-8434-d5bcf47502b7 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:13.499882 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-62c5d8f5-3a3b-47c8-8434-d5bcf47502b7 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:13.500716 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-62c5d8f5-3a3b-47c8-8434-d5bcf47502b7 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:13.501197 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-62c5d8f5-3a3b-47c8-8434-d5bcf47502b7 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:13.501787 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-62c5d8f5-3a3b-47c8-8434-d5bcf47502b7 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:13.531966 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b2a3151f-7bc2-485d-98ba-b8b8bc05aabe tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:13.541611 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b2a3151f-7bc2-485d-98ba-b8b8bc05aabe tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:13.543251 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b2a3151f-7bc2-485d-98ba-b8b8bc05aabe tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:13.544638 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b2a3151f-7bc2-485d-98ba-b8b8bc05aabe tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1808 microversion: 2.20 time: 0.168806 Sep 06 22:46:13.545602 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 233/477] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:46:13 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:46:13.574605 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-62c5d8f5-3a3b-47c8-8434-d5bcf47502b7 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:13.583791 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-62c5d8f5-3a3b-47c8-8434-d5bcf47502b7 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1187 microversion: 2.1 time: 0.095944 Sep 06 22:46:13.584570 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 245/478] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:13 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1187 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:46:14.082416 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-21538e46-1d9c-4461-a2d9-0ceff933e55d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:14.082934 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-21538e46-1d9c-4461-a2d9-0ceff933e55d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:14.088908 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21538e46-1d9c-4461-a2d9-0ceff933e55d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:14.089387 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21538e46-1d9c-4461-a2d9-0ceff933e55d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:14.089823 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21538e46-1d9c-4461-a2d9-0ceff933e55d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:14.090607 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21538e46-1d9c-4461-a2d9-0ceff933e55d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:14.091056 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21538e46-1d9c-4461-a2d9-0ceff933e55d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:14.091466 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21538e46-1d9c-4461-a2d9-0ceff933e55d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:14.236393 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b364db99-d114-489d-818b-eb7501afead4 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:14.237263 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b364db99-d114-489d-818b-eb7501afead4 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c396f306-9184-4575-9c97-3b0ef86a7d3d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:14.246315 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b364db99-d114-489d-818b-eb7501afead4 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:14.246941 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b364db99-d114-489d-818b-eb7501afead4 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:14.248986 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b364db99-d114-489d-818b-eb7501afead4 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:14.251619 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b364db99-d114-489d-818b-eb7501afead4 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:14.252262 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b364db99-d114-489d-818b-eb7501afead4 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:14.252864 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b364db99-d114-489d-818b-eb7501afead4 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:14.323507 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-21538e46-1d9c-4461-a2d9-0ceff933e55d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:14.335422 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-21538e46-1d9c-4461-a2d9-0ceff933e55d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126" status: 200 len: 1266 microversion: 2.1 time: 0.257295 Sep 06 22:46:14.336627 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 234/479] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:14 2022] GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:14.446063 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b364db99-d114-489d-818b-eb7501afead4 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8036279ef4384bdbfa8c37e46a1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebbea5186774c59942358c1fc284fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:14.455065 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b364db99-d114-489d-818b-eb7501afead4 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d" status: 200 len: 1319 microversion: 2.1 time: 0.222682 Sep 06 22:46:14.470010 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 246/480] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:14 2022] GET /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:14.571741 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f8e127c4-4621-49d2-b7ff-1201bc6d56e7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:14.572355 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f8e127c4-4621-49d2-b7ff-1201bc6d56e7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:14.580615 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:46:14.582263 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f8e127c4-4621-49d2-b7ff-1201bc6d56e7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:14.582787 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f8e127c4-4621-49d2-b7ff-1201bc6d56e7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:14.583208 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f8e127c4-4621-49d2-b7ff-1201bc6d56e7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:14.584245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f8e127c4-4621-49d2-b7ff-1201bc6d56e7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:14.584708 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f8e127c4-4621-49d2-b7ff-1201bc6d56e7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:14.585325 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f8e127c4-4621-49d2-b7ff-1201bc6d56e7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:14.607643 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-53c71f55-34dc-40ae-852e-e319543b9ab6 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:14.608256 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-53c71f55-34dc-40ae-852e-e319543b9ab6 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:14.622958 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-53c71f55-34dc-40ae-852e-e319543b9ab6 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:14.623629 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-53c71f55-34dc-40ae-852e-e319543b9ab6 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:14.624234 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-53c71f55-34dc-40ae-852e-e319543b9ab6 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:14.625315 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-53c71f55-34dc-40ae-852e-e319543b9ab6 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:14.626595 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-53c71f55-34dc-40ae-852e-e319543b9ab6 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:14.627175 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-53c71f55-34dc-40ae-852e-e319543b9ab6 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:14.631725 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:46:14.933908 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f8e127c4-4621-49d2-b7ff-1201bc6d56e7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:14.943286 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f8e127c4-4621-49d2-b7ff-1201bc6d56e7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:14.945107 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f8e127c4-4621-49d2-b7ff-1201bc6d56e7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:14.946482 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f8e127c4-4621-49d2-b7ff-1201bc6d56e7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1808 microversion: 2.20 time: 0.378762 Sep 06 22:46:14.957756 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-53c71f55-34dc-40ae-852e-e319543b9ab6 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:14.961252 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 235/481] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:46:14 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1808 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:46:14.970094 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-53c71f55-34dc-40ae-852e-e319543b9ab6 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1260 microversion: 2.1 time: 0.366062 Sep 06 22:46:14.970975 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 247/482] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:14 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1260 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:46:15.264604 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-ba07abb8-416a-4c5d-b963-f2ed3b7cfcdc req-69847bd6-c6f1-4a6b-836d-366a40de50fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13ef5db2-b5d1-41af-8c93-2851abb0b6dd", "name": "network-vif-plugged", "status": "completed", "tag": "2130f481-0970-42ca-bbc5-20da06de6a04"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:46:15.277899 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-ba07abb8-416a-4c5d-b963-f2ed3b7cfcdc req-69847bd6-c6f1-4a6b-836d-366a40de50fb service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:15.278379 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-ba07abb8-416a-4c5d-b963-f2ed3b7cfcdc req-69847bd6-c6f1-4a6b-836d-366a40de50fb service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:15.278800 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-ba07abb8-416a-4c5d-b963-f2ed3b7cfcdc req-69847bd6-c6f1-4a6b-836d-366a40de50fb service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:15.291063 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-ba07abb8-416a-4c5d-b963-f2ed3b7cfcdc req-69847bd6-c6f1-4a6b-836d-366a40de50fb service nova] Creating event network-vif-plugged:2130f481-0970-42ca-bbc5-20da06de6a04 for instance 13ef5db2-b5d1-41af-8c93-2851abb0b6dd on hv-cinder-85220 Sep 06 22:46:15.295808 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-ba07abb8-416a-4c5d-b963-f2ed3b7cfcdc req-69847bd6-c6f1-4a6b-836d-366a40de50fb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035730 Sep 06 22:46:15.296415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 236/483] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:46:15.361567 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6613c4d2-0b47-4c9c-916c-d1cb2b1b85aa tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:15.362293 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-6613c4d2-0b47-4c9c-916c-d1cb2b1b85aa tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:15.368536 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6613c4d2-0b47-4c9c-916c-d1cb2b1b85aa tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:15.369046 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6613c4d2-0b47-4c9c-916c-d1cb2b1b85aa tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:15.369777 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6613c4d2-0b47-4c9c-916c-d1cb2b1b85aa tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:15.370471 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6613c4d2-0b47-4c9c-916c-d1cb2b1b85aa tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:15.370916 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6613c4d2-0b47-4c9c-916c-d1cb2b1b85aa tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:15.371331 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6613c4d2-0b47-4c9c-916c-d1cb2b1b85aa tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:15.480334 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-86ca8eb1-67c6-41e2-a194-88251a24de19 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:15.481227 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-86ca8eb1-67c6-41e2-a194-88251a24de19 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c396f306-9184-4575-9c97-3b0ef86a7d3d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:15.488461 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-86ca8eb1-67c6-41e2-a194-88251a24de19 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:15.489378 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-86ca8eb1-67c6-41e2-a194-88251a24de19 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:15.489519 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-86ca8eb1-67c6-41e2-a194-88251a24de19 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:15.490321 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-86ca8eb1-67c6-41e2-a194-88251a24de19 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:15.490985 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-86ca8eb1-67c6-41e2-a194-88251a24de19 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:15.491453 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-86ca8eb1-67c6-41e2-a194-88251a24de19 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:15.682696 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6613c4d2-0b47-4c9c-916c-d1cb2b1b85aa tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:15.692166 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-6613c4d2-0b47-4c9c-916c-d1cb2b1b85aa tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126" status: 200 len: 1266 microversion: 2.1 time: 0.335394 Sep 06 22:46:15.693056 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 248/484] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:15 2022] GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 => generated 1266 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:15.720164 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-86ca8eb1-67c6-41e2-a194-88251a24de19 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8036279ef4384bdbfa8c37e46a1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebbea5186774c59942358c1fc284fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:15.728032 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-86ca8eb1-67c6-41e2-a194-88251a24de19 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d" status: 200 len: 1319 microversion: 2.1 time: 0.252302 Sep 06 22:46:15.729065 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 237/485] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:15 2022] GET /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:15.848934 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-0665cfe3-841f-4e82-80b7-21ba2ceb39cc req-7201b6e3-8d86-451d-9b06-7a577fc575df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43a8e21a-339a-4ea5-ad07-4d74e92be9de", "tag": "1501f706-7e9c-4f45-b83a-b0e52d8d1f26"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:46:15.858134 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-0665cfe3-841f-4e82-80b7-21ba2ceb39cc req-7201b6e3-8d86-451d-9b06-7a577fc575df service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:15.858601 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-0665cfe3-841f-4e82-80b7-21ba2ceb39cc req-7201b6e3-8d86-451d-9b06-7a577fc575df service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:15.859016 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-0665cfe3-841f-4e82-80b7-21ba2ceb39cc req-7201b6e3-8d86-451d-9b06-7a577fc575df service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:15.870697 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-0665cfe3-841f-4e82-80b7-21ba2ceb39cc req-7201b6e3-8d86-451d-9b06-7a577fc575df service nova] Creating event network-changed:1501f706-7e9c-4f45-b83a-b0e52d8d1f26 for instance 43a8e21a-339a-4ea5-ad07-4d74e92be9de on hv-cinder-85220 Sep 06 22:46:15.875810 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-0665cfe3-841f-4e82-80b7-21ba2ceb39cc req-7201b6e3-8d86-451d-9b06-7a577fc575df service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030756 Sep 06 22:46:15.876317 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 249/486] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 22:46:15.973076 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b65eae0a-4864-43b6-9b1b-3871bf78fbac tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:15.973808 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b65eae0a-4864-43b6-9b1b-3871bf78fbac tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:15.979810 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b65eae0a-4864-43b6-9b1b-3871bf78fbac tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:15.980225 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b65eae0a-4864-43b6-9b1b-3871bf78fbac tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:15.980651 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b65eae0a-4864-43b6-9b1b-3871bf78fbac tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:15.981361 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b65eae0a-4864-43b6-9b1b-3871bf78fbac tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:15.981806 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b65eae0a-4864-43b6-9b1b-3871bf78fbac tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:15.982215 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b65eae0a-4864-43b6-9b1b-3871bf78fbac tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:15.994082 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e38281ff-62ba-48c8-843b-cc277b13722f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:15.994780 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e38281ff-62ba-48c8-843b-cc277b13722f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:16.001998 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e38281ff-62ba-48c8-843b-cc277b13722f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:16.002476 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e38281ff-62ba-48c8-843b-cc277b13722f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:16.002902 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e38281ff-62ba-48c8-843b-cc277b13722f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:16.003579 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e38281ff-62ba-48c8-843b-cc277b13722f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:16.004022 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e38281ff-62ba-48c8-843b-cc277b13722f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:16.004432 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e38281ff-62ba-48c8-843b-cc277b13722f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:16.189486 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b65eae0a-4864-43b6-9b1b-3871bf78fbac tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:16.197874 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e38281ff-62ba-48c8-843b-cc277b13722f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:16.198102 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b65eae0a-4864-43b6-9b1b-3871bf78fbac tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:16.199599 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b65eae0a-4864-43b6-9b1b-3871bf78fbac tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:16.200773 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b65eae0a-4864-43b6-9b1b-3871bf78fbac tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1808 microversion: 2.20 time: 0.232097 Sep 06 22:46:16.201347 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 238/487] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:46:15 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1808 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:46:16.205865 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e38281ff-62ba-48c8-843b-cc277b13722f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1260 microversion: 2.1 time: 0.215866 Sep 06 22:46:16.206425 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 250/488] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:15 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1260 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:46:16.714923 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bdf8cf0d-608d-4c0b-9e5f-c282a1dd5da5 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:16.715446 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bdf8cf0d-608d-4c0b-9e5f-c282a1dd5da5 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:16.722102 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bdf8cf0d-608d-4c0b-9e5f-c282a1dd5da5 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:16.722652 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bdf8cf0d-608d-4c0b-9e5f-c282a1dd5da5 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:16.723001 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bdf8cf0d-608d-4c0b-9e5f-c282a1dd5da5 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:16.723687 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bdf8cf0d-608d-4c0b-9e5f-c282a1dd5da5 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:16.724136 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bdf8cf0d-608d-4c0b-9e5f-c282a1dd5da5 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:16.724554 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bdf8cf0d-608d-4c0b-9e5f-c282a1dd5da5 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:16.751800 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-64ba5512-aa07-4466-b01a-807b9607c5a9 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:16.752401 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-64ba5512-aa07-4466-b01a-807b9607c5a9 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c396f306-9184-4575-9c97-3b0ef86a7d3d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:16.758354 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-64ba5512-aa07-4466-b01a-807b9607c5a9 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:16.758834 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-64ba5512-aa07-4466-b01a-807b9607c5a9 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:16.759261 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-64ba5512-aa07-4466-b01a-807b9607c5a9 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:16.759944 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-64ba5512-aa07-4466-b01a-807b9607c5a9 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:16.760390 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-64ba5512-aa07-4466-b01a-807b9607c5a9 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:16.760826 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-64ba5512-aa07-4466-b01a-807b9607c5a9 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:16.950182 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bdf8cf0d-608d-4c0b-9e5f-c282a1dd5da5 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:16.959085 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bdf8cf0d-608d-4c0b-9e5f-c282a1dd5da5 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126" status: 200 len: 1266 microversion: 2.1 time: 0.247837 Sep 06 22:46:16.960584 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 239/489] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:16 2022] GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:17.041389 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-64ba5512-aa07-4466-b01a-807b9607c5a9 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8036279ef4384bdbfa8c37e46a1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebbea5186774c59942358c1fc284fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:17.050626 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-64ba5512-aa07-4466-b01a-807b9607c5a9 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d" status: 200 len: 1319 microversion: 2.1 time: 0.303186 Sep 06 22:46:17.051513 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 251/490] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:16 2022] GET /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:46:17.227935 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b98310c2-02e7-48d9-a2b3-ff8c66e78217 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:17.228545 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b98310c2-02e7-48d9-a2b3-ff8c66e78217 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:17.236939 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9635044f-1151-4fd9-ae86-daa855cbebc5 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:17.237550 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9635044f-1151-4fd9-ae86-daa855cbebc5 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:17.241570 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b98310c2-02e7-48d9-a2b3-ff8c66e78217 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:17.242062 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b98310c2-02e7-48d9-a2b3-ff8c66e78217 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:17.242495 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b98310c2-02e7-48d9-a2b3-ff8c66e78217 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:17.243194 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b98310c2-02e7-48d9-a2b3-ff8c66e78217 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:17.243648 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b98310c2-02e7-48d9-a2b3-ff8c66e78217 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:17.244073 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b98310c2-02e7-48d9-a2b3-ff8c66e78217 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:17.254530 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9635044f-1151-4fd9-ae86-daa855cbebc5 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:17.255185 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9635044f-1151-4fd9-ae86-daa855cbebc5 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:17.255710 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9635044f-1151-4fd9-ae86-daa855cbebc5 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:17.256650 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9635044f-1151-4fd9-ae86-daa855cbebc5 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:17.257291 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9635044f-1151-4fd9-ae86-daa855cbebc5 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:17.257839 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9635044f-1151-4fd9-ae86-daa855cbebc5 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:17.456672 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b98310c2-02e7-48d9-a2b3-ff8c66e78217 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:17.465493 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9635044f-1151-4fd9-ae86-daa855cbebc5 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:17.465690 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b98310c2-02e7-48d9-a2b3-ff8c66e78217 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:17.467513 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b98310c2-02e7-48d9-a2b3-ff8c66e78217 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:17.468429 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b98310c2-02e7-48d9-a2b3-ff8c66e78217 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1808 microversion: 2.20 time: 0.244907 Sep 06 22:46:17.474499 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 240/491] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:46:17 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1808 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:46:17.475520 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9635044f-1151-4fd9-ae86-daa855cbebc5 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1260 microversion: 2.1 time: 0.243062 Sep 06 22:46:17.476358 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 252/492] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:17 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1260 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:17.479942 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-721810cb-1a7f-4122-97ac-62f76ecdbace req-abd7c086-33d7-47e1-9e5a-a1d8992af608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c396f306-9184-4575-9c97-3b0ef86a7d3d", "name": "network-vif-plugged", "status": "completed", "tag": "75bdd4fe-9e1c-43fe-b117-ea174c811267"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:46:17.489902 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-721810cb-1a7f-4122-97ac-62f76ecdbace req-abd7c086-33d7-47e1-9e5a-a1d8992af608 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:17.490382 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-721810cb-1a7f-4122-97ac-62f76ecdbace req-abd7c086-33d7-47e1-9e5a-a1d8992af608 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:17.490809 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-721810cb-1a7f-4122-97ac-62f76ecdbace req-abd7c086-33d7-47e1-9e5a-a1d8992af608 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:17.502453 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-721810cb-1a7f-4122-97ac-62f76ecdbace req-abd7c086-33d7-47e1-9e5a-a1d8992af608 service nova] Creating event network-vif-plugged:75bdd4fe-9e1c-43fe-b117-ea174c811267 for instance c396f306-9184-4575-9c97-3b0ef86a7d3d on hv-cinder-85220 Sep 06 22:46:17.507633 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-721810cb-1a7f-4122-97ac-62f76ecdbace req-abd7c086-33d7-47e1-9e5a-a1d8992af608 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031949 Sep 06 22:46:17.508222 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 241/493] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:46:17.901605 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b3cf6903-f9ea-48cb-a600-2c9f1c324a74 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:17.902179 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b3cf6903-f9ea-48cb-a600-2c9f1c324a74 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:17.904105 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:46:17.909880 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b3cf6903-f9ea-48cb-a600-2c9f1c324a74 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:17.910354 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b3cf6903-f9ea-48cb-a600-2c9f1c324a74 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:17.910772 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b3cf6903-f9ea-48cb-a600-2c9f1c324a74 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:17.911439 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b3cf6903-f9ea-48cb-a600-2c9f1c324a74 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:17.911875 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b3cf6903-f9ea-48cb-a600-2c9f1c324a74 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:17.912301 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b3cf6903-f9ea-48cb-a600-2c9f1c324a74 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:17.983629 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c215f390-c74f-4f11-a815-4b33fb9386b7 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:17.985142 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c215f390-c74f-4f11-a815-4b33fb9386b7 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:17.991299 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c215f390-c74f-4f11-a815-4b33fb9386b7 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:17.991785 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c215f390-c74f-4f11-a815-4b33fb9386b7 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:17.992211 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c215f390-c74f-4f11-a815-4b33fb9386b7 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:17.992928 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c215f390-c74f-4f11-a815-4b33fb9386b7 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:17.993377 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c215f390-c74f-4f11-a815-4b33fb9386b7 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:17.993793 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c215f390-c74f-4f11-a815-4b33fb9386b7 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:18.034872 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.objects.instance [None req-b3cf6903-f9ea-48cb-a600-2c9f1c324a74 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lazy-loading 'services' on Instance uuid 7bd3f7df-0b7f-451c-b6ea-c91792e466e5 {{(pid=127087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 22:46:18.130898 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c215f390-c74f-4f11-a815-4b33fb9386b7 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:18.139842 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c215f390-c74f-4f11-a815-4b33fb9386b7 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126" status: 200 len: 1266 microversion: 2.1 time: 0.160445 Sep 06 22:46:18.152555 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 242/494] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:17 2022] GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:46:18.152555 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7f13b853-39be-42ca-a380-3000f84e6ade tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:18.152555 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7f13b853-39be-42ca-a380-3000f84e6ade tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c396f306-9184-4575-9c97-3b0ef86a7d3d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:18.152555 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7f13b853-39be-42ca-a380-3000f84e6ade tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:18.153093 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7f13b853-39be-42ca-a380-3000f84e6ade tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:18.153344 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7f13b853-39be-42ca-a380-3000f84e6ade tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:18.154211 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7f13b853-39be-42ca-a380-3000f84e6ade tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:18.154814 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7f13b853-39be-42ca-a380-3000f84e6ade tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:18.155252 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7f13b853-39be-42ca-a380-3000f84e6ade tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:18.164942 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b3cf6903-f9ea-48cb-a600-2c9f1c324a74 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5/os-volume_attachments/a967eca1-c0ec-4dfe-bbbe-fd20be3dc6f7" status: 202 len: 0 microversion: 2.1 time: 0.267279 Sep 06 22:46:18.165848 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 253/495] 10.222.0.39 () {58 vars in 1416 bytes} [Tue Sep 6 22:46:17 2022] DELETE /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5/os-volume_attachments/a967eca1-c0ec-4dfe-bbbe-fd20be3dc6f7 => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 22:46:18.295631 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7f13b853-39be-42ca-a380-3000f84e6ade tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8036279ef4384bdbfa8c37e46a1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebbea5186774c59942358c1fc284fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:18.303351 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7f13b853-39be-42ca-a380-3000f84e6ade tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d" status: 200 len: 1319 microversion: 2.1 time: 0.161228 Sep 06 22:46:18.303913 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 243/496] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:18 2022] GET /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:18.495278 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-824fa8ed-41e9-47eb-ae6c-9ca9973a8a8d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:18.496023 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-824fa8ed-41e9-47eb-ae6c-9ca9973a8a8d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:18.497997 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7e025eba-2995-496b-a865-4f7467a035f2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:18.498610 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7e025eba-2995-496b-a865-4f7467a035f2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:18.503485 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-824fa8ed-41e9-47eb-ae6c-9ca9973a8a8d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:18.504104 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-824fa8ed-41e9-47eb-ae6c-9ca9973a8a8d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:18.504624 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-824fa8ed-41e9-47eb-ae6c-9ca9973a8a8d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:18.505111 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7e025eba-2995-496b-a865-4f7467a035f2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:18.505543 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-824fa8ed-41e9-47eb-ae6c-9ca9973a8a8d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:18.505654 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7e025eba-2995-496b-a865-4f7467a035f2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:18.506006 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7e025eba-2995-496b-a865-4f7467a035f2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:18.506228 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-824fa8ed-41e9-47eb-ae6c-9ca9973a8a8d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:18.506692 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7e025eba-2995-496b-a865-4f7467a035f2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:18.506800 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-824fa8ed-41e9-47eb-ae6c-9ca9973a8a8d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:18.507136 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7e025eba-2995-496b-a865-4f7467a035f2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:18.507553 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7e025eba-2995-496b-a865-4f7467a035f2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:18.709403 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-824fa8ed-41e9-47eb-ae6c-9ca9973a8a8d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:18.713628 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7e025eba-2995-496b-a865-4f7467a035f2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:18.718194 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-824fa8ed-41e9-47eb-ae6c-9ca9973a8a8d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:18.720485 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-824fa8ed-41e9-47eb-ae6c-9ca9973a8a8d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:18.721828 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-824fa8ed-41e9-47eb-ae6c-9ca9973a8a8d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1808 microversion: 2.20 time: 0.230986 Sep 06 22:46:18.722391 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 254/497] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:46:18 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1808 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:46:18.723248 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7e025eba-2995-496b-a865-4f7467a035f2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1260 microversion: 2.1 time: 0.229068 Sep 06 22:46:18.723824 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 244/498] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:18 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1260 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:46:19.164124 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-c134ffac-e7ea-4a00-a2e5-cc12e82b46c1 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:19.164710 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-c134ffac-e7ea-4a00-a2e5-cc12e82b46c1 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:19.171454 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c134ffac-e7ea-4a00-a2e5-cc12e82b46c1 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:19.172149 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c134ffac-e7ea-4a00-a2e5-cc12e82b46c1 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:19.172369 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c134ffac-e7ea-4a00-a2e5-cc12e82b46c1 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:19.173251 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c134ffac-e7ea-4a00-a2e5-cc12e82b46c1 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:19.173704 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c134ffac-e7ea-4a00-a2e5-cc12e82b46c1 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:19.174122 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c134ffac-e7ea-4a00-a2e5-cc12e82b46c1 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:19.189281 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:46:19.311768 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-c134ffac-e7ea-4a00-a2e5-cc12e82b46c1 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:19.320252 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-c134ffac-e7ea-4a00-a2e5-cc12e82b46c1 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126" status: 200 len: 1266 microversion: 2.1 time: 0.160656 Sep 06 22:46:19.320874 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 255/499] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:19 2022] GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:19.326304 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-21d17de7-bc27-4453-a30b-bfa028fe3fb2 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:19.326910 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-21d17de7-bc27-4453-a30b-bfa028fe3fb2 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c396f306-9184-4575-9c97-3b0ef86a7d3d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:19.333936 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21d17de7-bc27-4453-a30b-bfa028fe3fb2 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:19.334412 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21d17de7-bc27-4453-a30b-bfa028fe3fb2 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:19.334861 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21d17de7-bc27-4453-a30b-bfa028fe3fb2 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:19.335539 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21d17de7-bc27-4453-a30b-bfa028fe3fb2 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:19.335981 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21d17de7-bc27-4453-a30b-bfa028fe3fb2 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:19.336393 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-21d17de7-bc27-4453-a30b-bfa028fe3fb2 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:19.466333 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-21d17de7-bc27-4453-a30b-bfa028fe3fb2 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8036279ef4384bdbfa8c37e46a1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebbea5186774c59942358c1fc284fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:19.474646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-21d17de7-bc27-4453-a30b-bfa028fe3fb2 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d" status: 200 len: 1319 microversion: 2.1 time: 0.152372 Sep 06 22:46:19.475303 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 245/500] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:19 2022] GET /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:19.523824 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-ac899604-d20d-4807-b3b2-764a3519106f req-10c582ed-1ee1-4862-844d-d1cbf0b668ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7930b2ec-9579-46df-a554-d9b9ba019126", "name": "network-vif-plugged", "status": "completed", "tag": "a641f658-6203-4321-afb0-71036d26ddf5"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:46:19.534308 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-ac899604-d20d-4807-b3b2-764a3519106f req-10c582ed-1ee1-4862-844d-d1cbf0b668ac service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:19.534672 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-ac899604-d20d-4807-b3b2-764a3519106f req-10c582ed-1ee1-4862-844d-d1cbf0b668ac service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:19.535091 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-ac899604-d20d-4807-b3b2-764a3519106f req-10c582ed-1ee1-4862-844d-d1cbf0b668ac service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:19.547652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-ac899604-d20d-4807-b3b2-764a3519106f req-10c582ed-1ee1-4862-844d-d1cbf0b668ac service nova] Creating event network-vif-plugged:a641f658-6203-4321-afb0-71036d26ddf5 for instance 7930b2ec-9579-46df-a554-d9b9ba019126 on hv-cinder-85220 Sep 06 22:46:19.552609 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-ac899604-d20d-4807-b3b2-764a3519106f req-10c582ed-1ee1-4862-844d-d1cbf0b668ac service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033428 Sep 06 22:46:19.553569 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 256/501] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:46:19.746899 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-972b3b1d-56df-4227-9714-c4daeb31e792 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:19.747534 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-972b3b1d-56df-4227-9714-c4daeb31e792 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:19.748089 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-8472aef9-b44e-4dd6-85c5-cecc5ae7743b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:19.748830 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-8472aef9-b44e-4dd6-85c5-cecc5ae7743b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:19.754618 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-972b3b1d-56df-4227-9714-c4daeb31e792 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:19.755097 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-972b3b1d-56df-4227-9714-c4daeb31e792 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:19.755539 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-972b3b1d-56df-4227-9714-c4daeb31e792 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:19.756203 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-972b3b1d-56df-4227-9714-c4daeb31e792 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:19.756388 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8472aef9-b44e-4dd6-85c5-cecc5ae7743b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:19.756645 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-972b3b1d-56df-4227-9714-c4daeb31e792 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:19.756887 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8472aef9-b44e-4dd6-85c5-cecc5ae7743b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:19.757095 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-972b3b1d-56df-4227-9714-c4daeb31e792 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:19.757310 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8472aef9-b44e-4dd6-85c5-cecc5ae7743b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:19.757983 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8472aef9-b44e-4dd6-85c5-cecc5ae7743b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:19.758420 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8472aef9-b44e-4dd6-85c5-cecc5ae7743b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:19.759529 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8472aef9-b44e-4dd6-85c5-cecc5ae7743b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:19.952145 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-972b3b1d-56df-4227-9714-c4daeb31e792 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:19.955633 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-8472aef9-b44e-4dd6-85c5-cecc5ae7743b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:19.959893 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-972b3b1d-56df-4227-9714-c4daeb31e792 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1260 microversion: 2.1 time: 0.217514 Sep 06 22:46:19.960471 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 246/502] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:19 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1260 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:46:19.964152 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-8472aef9-b44e-4dd6-85c5-cecc5ae7743b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:19.965653 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-8472aef9-b44e-4dd6-85c5-cecc5ae7743b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:19.966782 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-8472aef9-b44e-4dd6-85c5-cecc5ae7743b tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1795 microversion: 2.20 time: 0.223217 Sep 06 22:46:19.967319 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 257/503] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:46:19 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1795 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:46:20.346271 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9da583f5-08ae-47c4-8a3a-eaf057005d3b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:20.346939 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9da583f5-08ae-47c4-8a3a-eaf057005d3b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:20.353451 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9da583f5-08ae-47c4-8a3a-eaf057005d3b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:20.353940 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9da583f5-08ae-47c4-8a3a-eaf057005d3b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:20.354401 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9da583f5-08ae-47c4-8a3a-eaf057005d3b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:20.355097 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9da583f5-08ae-47c4-8a3a-eaf057005d3b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:20.355555 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9da583f5-08ae-47c4-8a3a-eaf057005d3b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:20.355977 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9da583f5-08ae-47c4-8a3a-eaf057005d3b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:20.489178 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9da583f5-08ae-47c4-8a3a-eaf057005d3b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:20.496959 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9da583f5-08ae-47c4-8a3a-eaf057005d3b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126" status: 200 len: 1266 microversion: 2.1 time: 0.157289 Sep 06 22:46:20.497527 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 247/504] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:20 2022] GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:20.497653 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-cce8f7d3-e15d-4337-a51c-ada638c435dc tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:20.498131 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-cce8f7d3-e15d-4337-a51c-ada638c435dc tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c396f306-9184-4575-9c97-3b0ef86a7d3d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:20.504282 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cce8f7d3-e15d-4337-a51c-ada638c435dc tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:20.504739 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cce8f7d3-e15d-4337-a51c-ada638c435dc tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:20.505193 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cce8f7d3-e15d-4337-a51c-ada638c435dc tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:20.505869 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cce8f7d3-e15d-4337-a51c-ada638c435dc tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:20.506596 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cce8f7d3-e15d-4337-a51c-ada638c435dc tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:20.506705 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cce8f7d3-e15d-4337-a51c-ada638c435dc tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:20.642066 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-cce8f7d3-e15d-4337-a51c-ada638c435dc tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8036279ef4384bdbfa8c37e46a1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebbea5186774c59942358c1fc284fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:20.649912 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-cce8f7d3-e15d-4337-a51c-ada638c435dc tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d" status: 200 len: 1319 microversion: 2.1 time: 0.156059 Sep 06 22:46:20.650481 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 258/505] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:20 2022] GET /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:46:20.982554 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-046f3c03-50eb-4dbf-9d03-99b4146e9e49 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:20.983166 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-046f3c03-50eb-4dbf-9d03-99b4146e9e49 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:20.989267 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-046f3c03-50eb-4dbf-9d03-99b4146e9e49 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:20.989752 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-046f3c03-50eb-4dbf-9d03-99b4146e9e49 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:20.990183 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-046f3c03-50eb-4dbf-9d03-99b4146e9e49 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:20.990885 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-046f3c03-50eb-4dbf-9d03-99b4146e9e49 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:20.991320 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-046f3c03-50eb-4dbf-9d03-99b4146e9e49 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:20.991741 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-046f3c03-50eb-4dbf-9d03-99b4146e9e49 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:21.121900 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-046f3c03-50eb-4dbf-9d03-99b4146e9e49 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:21.130084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-046f3c03-50eb-4dbf-9d03-99b4146e9e49 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1260 microversion: 2.1 time: 0.151448 Sep 06 22:46:21.130649 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 248/506] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:20 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:21.520013 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-4e641515-4f18-4f5a-8069-7823f188bb19 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:21.521385 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-4e641515-4f18-4f5a-8069-7823f188bb19 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:21.528379 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4e641515-4f18-4f5a-8069-7823f188bb19 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:21.528895 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4e641515-4f18-4f5a-8069-7823f188bb19 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:21.529326 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4e641515-4f18-4f5a-8069-7823f188bb19 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:21.530025 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4e641515-4f18-4f5a-8069-7823f188bb19 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:21.530476 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4e641515-4f18-4f5a-8069-7823f188bb19 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:21.530893 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4e641515-4f18-4f5a-8069-7823f188bb19 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:21.669894 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-4e641515-4f18-4f5a-8069-7823f188bb19 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:21.673714 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1c5ee5e9-2904-4cc7-b851-52d48e473650 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:21.674836 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1c5ee5e9-2904-4cc7-b851-52d48e473650 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c396f306-9184-4575-9c97-3b0ef86a7d3d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:21.680933 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1c5ee5e9-2904-4cc7-b851-52d48e473650 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:21.681430 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1c5ee5e9-2904-4cc7-b851-52d48e473650 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:21.681863 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1c5ee5e9-2904-4cc7-b851-52d48e473650 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:21.682568 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1c5ee5e9-2904-4cc7-b851-52d48e473650 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:21.683018 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1c5ee5e9-2904-4cc7-b851-52d48e473650 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:21.683442 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1c5ee5e9-2904-4cc7-b851-52d48e473650 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:21.684460 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-4e641515-4f18-4f5a-8069-7823f188bb19 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126" status: 200 len: 1266 microversion: 2.1 time: 0.168563 Sep 06 22:46:21.685264 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 259/507] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:21 2022] GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:21.821825 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1c5ee5e9-2904-4cc7-b851-52d48e473650 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8036279ef4384bdbfa8c37e46a1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebbea5186774c59942358c1fc284fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:21.830198 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1c5ee5e9-2904-4cc7-b851-52d48e473650 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d" status: 200 len: 1508 microversion: 2.1 time: 0.160866 Sep 06 22:46:21.831024 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 249/508] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:21 2022] GET /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:46:21.855053 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-dee20eae-78cd-4600-91e1-9913f7fc0faf tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20131c96-cbbf-4e92-9569-08c7d0e978d8", "device": "/dev/sdb"}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:46:21.858983 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-dee20eae-78cd-4600-91e1-9913f7fc0faf tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c396f306-9184-4575-9c97-3b0ef86a7d3d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:21.865723 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dee20eae-78cd-4600-91e1-9913f7fc0faf tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:21.866281 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dee20eae-78cd-4600-91e1-9913f7fc0faf tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:21.866633 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dee20eae-78cd-4600-91e1-9913f7fc0faf tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:21.867307 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dee20eae-78cd-4600-91e1-9913f7fc0faf tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:21.867746 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dee20eae-78cd-4600-91e1-9913f7fc0faf tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:21.868154 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dee20eae-78cd-4600-91e1-9913f7fc0faf tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:22.153695 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-02503499-c607-4731-a55e-5fcd602fa8f2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:22.154310 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-02503499-c607-4731-a55e-5fcd602fa8f2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:22.160750 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-02503499-c607-4731-a55e-5fcd602fa8f2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:22.161444 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-02503499-c607-4731-a55e-5fcd602fa8f2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:22.161869 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-02503499-c607-4731-a55e-5fcd602fa8f2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:22.162551 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-02503499-c607-4731-a55e-5fcd602fa8f2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:22.162993 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-02503499-c607-4731-a55e-5fcd602fa8f2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:22.163397 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-02503499-c607-4731-a55e-5fcd602fa8f2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:22.182154 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=4 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:46:22.200011 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=12 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:46:22.290310 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-02503499-c607-4731-a55e-5fcd602fa8f2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:22.297875 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-02503499-c607-4731-a55e-5fcd602fa8f2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1260 microversion: 2.1 time: 0.148078 Sep 06 22:46:22.298435 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 250/509] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:22 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:46:22.464480 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=4 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:46:22.472808 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-90a9fa0f-2976-4916-b644-8faaf3422338 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:46:22.478849 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-90a9fa0f-2976-4916-b644-8faaf3422338 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:22.479339 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-90a9fa0f-2976-4916-b644-8faaf3422338 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:22.479766 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-90a9fa0f-2976-4916-b644-8faaf3422338 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:22.503328 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-90a9fa0f-2976-4916-b644-8faaf3422338 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Going to try to stop instance {{(pid=127088) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 06 22:46:22.511420 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-dee20eae-78cd-4600-91e1-9913f7fc0faf tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "POST /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.661598 Sep 06 22:46:22.512492 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 260/510] 10.222.0.39 () {60 vars in 1323 bytes} [Tue Sep 6 22:46:21 2022] POST /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d/os-volume_attachments => generated 194 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:46:22.555348 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-90a9fa0f-2976-4916-b644-8faaf3422338 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "POST /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5/action" status: 202 len: 0 microversion: 2.1 time: 0.086107 Sep 06 22:46:22.555936 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 251/511] 10.222.0.39 () {60 vars in 1278 bytes} [Tue Sep 6 22:46:22 2022] POST /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 22:46:22.565147 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-091ea94b-edfb-44bb-9494-d93d74a35f10 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:22.565844 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-091ea94b-edfb-44bb-9494-d93d74a35f10 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:22.581007 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-091ea94b-edfb-44bb-9494-d93d74a35f10 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:22.581007 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-091ea94b-edfb-44bb-9494-d93d74a35f10 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:22.581007 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-091ea94b-edfb-44bb-9494-d93d74a35f10 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:22.581007 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-091ea94b-edfb-44bb-9494-d93d74a35f10 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:22.581622 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-091ea94b-edfb-44bb-9494-d93d74a35f10 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:22.581622 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-091ea94b-edfb-44bb-9494-d93d74a35f10 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:22.709757 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-670d4394-42b8-4f1c-bbd5-7302c0e75e39 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:22.711219 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-670d4394-42b8-4f1c-bbd5-7302c0e75e39 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:22.717654 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-670d4394-42b8-4f1c-bbd5-7302c0e75e39 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:22.719807 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-670d4394-42b8-4f1c-bbd5-7302c0e75e39 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:22.720263 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-670d4394-42b8-4f1c-bbd5-7302c0e75e39 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:22.721006 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-670d4394-42b8-4f1c-bbd5-7302c0e75e39 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:22.721465 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-670d4394-42b8-4f1c-bbd5-7302c0e75e39 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:22.721897 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-670d4394-42b8-4f1c-bbd5-7302c0e75e39 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:22.725251 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-091ea94b-edfb-44bb-9494-d93d74a35f10 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:22.733090 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-091ea94b-edfb-44bb-9494-d93d74a35f10 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1678 microversion: 2.1 time: 0.172702 Sep 06 22:46:22.733799 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 261/512] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:22 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:22.746897 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:46:22.866372 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-670d4394-42b8-4f1c-bbd5-7302c0e75e39 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:22.874245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-670d4394-42b8-4f1c-bbd5-7302c0e75e39 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126" status: 200 len: 1266 microversion: 2.1 time: 0.169128 Sep 06 22:46:22.874808 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 252/513] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:22 2022] GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:46:23.321583 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-1facdb54-e7fd-4770-9db9-0273c935bdf9 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:23.322170 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-1facdb54-e7fd-4770-9db9-0273c935bdf9 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:23.328397 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1facdb54-e7fd-4770-9db9-0273c935bdf9 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:23.329561 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1facdb54-e7fd-4770-9db9-0273c935bdf9 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:23.330550 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1facdb54-e7fd-4770-9db9-0273c935bdf9 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:23.331250 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1facdb54-e7fd-4770-9db9-0273c935bdf9 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:23.331699 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1facdb54-e7fd-4770-9db9-0273c935bdf9 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:23.332117 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1facdb54-e7fd-4770-9db9-0273c935bdf9 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:23.473271 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-1facdb54-e7fd-4770-9db9-0273c935bdf9 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:23.480845 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-1facdb54-e7fd-4770-9db9-0273c935bdf9 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1260 microversion: 2.1 time: 0.163240 Sep 06 22:46:23.482167 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 262/514] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:23 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:23.757662 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b0a975c9-acf0-4af4-9559-63697ad651e7 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:23.758211 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b0a975c9-acf0-4af4-9559-63697ad651e7 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:23.764614 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b0a975c9-acf0-4af4-9559-63697ad651e7 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:23.765126 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b0a975c9-acf0-4af4-9559-63697ad651e7 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:23.765562 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b0a975c9-acf0-4af4-9559-63697ad651e7 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:23.766304 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b0a975c9-acf0-4af4-9559-63697ad651e7 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:23.766744 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b0a975c9-acf0-4af4-9559-63697ad651e7 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:23.767173 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b0a975c9-acf0-4af4-9559-63697ad651e7 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:23.901932 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b42e0e91-ca1c-4a6a-9aa1-67b8131c4ef0 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:23.903833 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b42e0e91-ca1c-4a6a-9aa1-67b8131c4ef0 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:23.906265 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b0a975c9-acf0-4af4-9559-63697ad651e7 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:23.911422 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b42e0e91-ca1c-4a6a-9aa1-67b8131c4ef0 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:23.911931 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b42e0e91-ca1c-4a6a-9aa1-67b8131c4ef0 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:23.912404 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b42e0e91-ca1c-4a6a-9aa1-67b8131c4ef0 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:23.913137 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b42e0e91-ca1c-4a6a-9aa1-67b8131c4ef0 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:23.913579 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b42e0e91-ca1c-4a6a-9aa1-67b8131c4ef0 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:23.913989 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b42e0e91-ca1c-4a6a-9aa1-67b8131c4ef0 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:23.915431 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b0a975c9-acf0-4af4-9559-63697ad651e7 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1678 microversion: 2.1 time: 0.161717 Sep 06 22:46:23.916012 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 253/515] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:23 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:24.045462 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b42e0e91-ca1c-4a6a-9aa1-67b8131c4ef0 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:24.053517 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b42e0e91-ca1c-4a6a-9aa1-67b8131c4ef0 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126" status: 200 len: 1453 microversion: 2.1 time: 0.159369 Sep 06 22:46:24.054078 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 263/516] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:23 2022] GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:24.075623 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-cb5439d8-e561-48a5-a737-3e01f151b7d5 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:24.076255 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-cb5439d8-e561-48a5-a737-3e01f151b7d5 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:24.082330 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb5439d8-e561-48a5-a737-3e01f151b7d5 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:24.082806 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb5439d8-e561-48a5-a737-3e01f151b7d5 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:24.083230 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb5439d8-e561-48a5-a737-3e01f151b7d5 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:24.083900 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb5439d8-e561-48a5-a737-3e01f151b7d5 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:24.084344 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb5439d8-e561-48a5-a737-3e01f151b7d5 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:24.084811 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb5439d8-e561-48a5-a737-3e01f151b7d5 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:24.214535 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-cb5439d8-e561-48a5-a737-3e01f151b7d5 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:24.222968 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-cb5439d8-e561-48a5-a737-3e01f151b7d5 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126" status: 200 len: 1453 microversion: 2.1 time: 0.151180 Sep 06 22:46:24.223524 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 254/517] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:24 2022] GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:24.505384 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-7e7caf7d-1512-4590-9151-14ded5b00a0e tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:24.506158 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-7e7caf7d-1512-4590-9151-14ded5b00a0e tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:24.512101 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7e7caf7d-1512-4590-9151-14ded5b00a0e tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:24.512575 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7e7caf7d-1512-4590-9151-14ded5b00a0e tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:24.513034 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7e7caf7d-1512-4590-9151-14ded5b00a0e tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:24.513715 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7e7caf7d-1512-4590-9151-14ded5b00a0e tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:24.514152 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7e7caf7d-1512-4590-9151-14ded5b00a0e tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:24.514559 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7e7caf7d-1512-4590-9151-14ded5b00a0e tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:24.725865 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-7e7caf7d-1512-4590-9151-14ded5b00a0e tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:24.733439 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-7e7caf7d-1512-4590-9151-14ded5b00a0e tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1260 microversion: 2.1 time: 0.232656 Sep 06 22:46:24.734218 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 264/518] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:24 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1260 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:24.941589 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-01244580-f20e-4c43-b46e-e9098f0f1781 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:24.942386 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-01244580-f20e-4c43-b46e-e9098f0f1781 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:24.948511 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01244580-f20e-4c43-b46e-e9098f0f1781 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:24.949088 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01244580-f20e-4c43-b46e-e9098f0f1781 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:24.949514 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01244580-f20e-4c43-b46e-e9098f0f1781 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:24.950195 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01244580-f20e-4c43-b46e-e9098f0f1781 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:24.950635 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01244580-f20e-4c43-b46e-e9098f0f1781 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:24.951044 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-01244580-f20e-4c43-b46e-e9098f0f1781 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:25.163876 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-1861c453-6ef3-4ef3-83f2-23fb56c683eb req-8c6279e2-3cd8-43fb-a36e-ddb5cf43bd4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43a8e21a-339a-4ea5-ad07-4d74e92be9de", "name": "network-vif-plugged", "status": "completed", "tag": "1501f706-7e9c-4f45-b83a-b0e52d8d1f26"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:46:25.180390 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-1861c453-6ef3-4ef3-83f2-23fb56c683eb req-8c6279e2-3cd8-43fb-a36e-ddb5cf43bd4a service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:25.181306 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-1861c453-6ef3-4ef3-83f2-23fb56c683eb req-8c6279e2-3cd8-43fb-a36e-ddb5cf43bd4a service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:25.181732 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-1861c453-6ef3-4ef3-83f2-23fb56c683eb req-8c6279e2-3cd8-43fb-a36e-ddb5cf43bd4a service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:25.193502 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-1861c453-6ef3-4ef3-83f2-23fb56c683eb req-8c6279e2-3cd8-43fb-a36e-ddb5cf43bd4a service nova] Creating event network-vif-plugged:1501f706-7e9c-4f45-b83a-b0e52d8d1f26 for instance 43a8e21a-339a-4ea5-ad07-4d74e92be9de on hv-cinder-85220 Sep 06 22:46:25.199063 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-1861c453-6ef3-4ef3-83f2-23fb56c683eb req-8c6279e2-3cd8-43fb-a36e-ddb5cf43bd4a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039123 Sep 06 22:46:25.199869 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 265/519] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 22:46:25.211957 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-01244580-f20e-4c43-b46e-e9098f0f1781 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:25.222764 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-01244580-f20e-4c43-b46e-e9098f0f1781 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1678 microversion: 2.1 time: 0.286274 Sep 06 22:46:25.223695 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 255/520] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:24 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1678 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:25.761539 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f04d32a2-6d57-437f-be11-497e479f40b5 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:25.761539 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-f04d32a2-6d57-437f-be11-497e479f40b5 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:25.763682 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f04d32a2-6d57-437f-be11-497e479f40b5 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:25.764720 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f04d32a2-6d57-437f-be11-497e479f40b5 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:25.765383 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f04d32a2-6d57-437f-be11-497e479f40b5 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:25.766154 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f04d32a2-6d57-437f-be11-497e479f40b5 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:25.767185 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f04d32a2-6d57-437f-be11-497e479f40b5 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:25.767678 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f04d32a2-6d57-437f-be11-497e479f40b5 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:26.027798 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-f04d32a2-6d57-437f-be11-497e479f40b5 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:26.035661 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-f04d32a2-6d57-437f-be11-497e479f40b5 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1260 microversion: 2.1 time: 0.283660 Sep 06 22:46:26.036423 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 266/521] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:25 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1260 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:26.246024 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5df21537-a79a-4c55-afa9-5802e8e6157f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:26.246639 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5df21537-a79a-4c55-afa9-5802e8e6157f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:26.253621 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5df21537-a79a-4c55-afa9-5802e8e6157f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:26.254117 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5df21537-a79a-4c55-afa9-5802e8e6157f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:26.254554 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5df21537-a79a-4c55-afa9-5802e8e6157f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:26.255255 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5df21537-a79a-4c55-afa9-5802e8e6157f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:26.255706 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5df21537-a79a-4c55-afa9-5802e8e6157f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:26.256128 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5df21537-a79a-4c55-afa9-5802e8e6157f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:26.482772 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5df21537-a79a-4c55-afa9-5802e8e6157f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:26.490998 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5df21537-a79a-4c55-afa9-5802e8e6157f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1678 microversion: 2.1 time: 0.248810 Sep 06 22:46:26.491574 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 256/522] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:26 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1678 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:26.708586 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-cab527ac-a04b-4d3f-8eb7-7450ae8fb21a req-63aefb93-2348-4ada-a330-ff6f562b2fc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7930b2ec-9579-46df-a554-d9b9ba019126", "tag": "a641f658-6203-4321-afb0-71036d26ddf5"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:46:26.718059 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-cab527ac-a04b-4d3f-8eb7-7450ae8fb21a req-63aefb93-2348-4ada-a330-ff6f562b2fc6 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:26.718523 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-cab527ac-a04b-4d3f-8eb7-7450ae8fb21a req-63aefb93-2348-4ada-a330-ff6f562b2fc6 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:26.718941 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-cab527ac-a04b-4d3f-8eb7-7450ae8fb21a req-63aefb93-2348-4ada-a330-ff6f562b2fc6 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:26.730612 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-cab527ac-a04b-4d3f-8eb7-7450ae8fb21a req-63aefb93-2348-4ada-a330-ff6f562b2fc6 service nova] Creating event network-changed:a641f658-6203-4321-afb0-71036d26ddf5 for instance 7930b2ec-9579-46df-a554-d9b9ba019126 on hv-cinder-85220 Sep 06 22:46:26.735588 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-cab527ac-a04b-4d3f-8eb7-7450ae8fb21a req-63aefb93-2348-4ada-a330-ff6f562b2fc6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031063 Sep 06 22:46:26.736358 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 267/523] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:46:27.060646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1506f90c-3490-4638-90c0-3573a11c82e9 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:27.061871 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1506f90c-3490-4638-90c0-3573a11c82e9 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:27.069092 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1506f90c-3490-4638-90c0-3573a11c82e9 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:27.069742 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1506f90c-3490-4638-90c0-3573a11c82e9 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:27.070232 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1506f90c-3490-4638-90c0-3573a11c82e9 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:27.071133 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1506f90c-3490-4638-90c0-3573a11c82e9 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:27.071579 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1506f90c-3490-4638-90c0-3573a11c82e9 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:27.071991 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1506f90c-3490-4638-90c0-3573a11c82e9 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:27.256021 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1506f90c-3490-4638-90c0-3573a11c82e9 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:27.267763 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1506f90c-3490-4638-90c0-3573a11c82e9 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1260 microversion: 2.1 time: 0.212280 Sep 06 22:46:27.273932 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 257/524] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:27 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1260 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:27.515487 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-4fdaae43-001d-41ba-9ca3-0d48a0c146fa tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:27.516181 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-4fdaae43-001d-41ba-9ca3-0d48a0c146fa tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:27.523110 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4fdaae43-001d-41ba-9ca3-0d48a0c146fa tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:27.523594 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4fdaae43-001d-41ba-9ca3-0d48a0c146fa tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:27.524026 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4fdaae43-001d-41ba-9ca3-0d48a0c146fa tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:27.524721 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4fdaae43-001d-41ba-9ca3-0d48a0c146fa tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:27.525216 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4fdaae43-001d-41ba-9ca3-0d48a0c146fa tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:27.525635 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4fdaae43-001d-41ba-9ca3-0d48a0c146fa tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:27.663480 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-4fdaae43-001d-41ba-9ca3-0d48a0c146fa tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:27.671524 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-4fdaae43-001d-41ba-9ca3-0d48a0c146fa tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1678 microversion: 2.1 time: 0.160136 Sep 06 22:46:27.672145 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 268/525] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:27 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:28.290300 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e2374940-30e7-4d2b-92c9-75e51e637115 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:28.290905 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e2374940-30e7-4d2b-92c9-75e51e637115 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:28.297348 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e2374940-30e7-4d2b-92c9-75e51e637115 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:28.298128 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e2374940-30e7-4d2b-92c9-75e51e637115 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:28.298511 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e2374940-30e7-4d2b-92c9-75e51e637115 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:28.299195 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e2374940-30e7-4d2b-92c9-75e51e637115 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:28.299643 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e2374940-30e7-4d2b-92c9-75e51e637115 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:28.300060 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e2374940-30e7-4d2b-92c9-75e51e637115 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:28.433112 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e2374940-30e7-4d2b-92c9-75e51e637115 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:28.441317 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e2374940-30e7-4d2b-92c9-75e51e637115 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1445 microversion: 2.1 time: 0.154905 Sep 06 22:46:28.441875 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 258/526] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:28 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1445 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:28.463280 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d2cf713b-090f-403c-a150-74fafc05ec35 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:28.463873 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-d2cf713b-090f-403c-a150-74fafc05ec35 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:28.470333 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d2cf713b-090f-403c-a150-74fafc05ec35 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:28.470804 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d2cf713b-090f-403c-a150-74fafc05ec35 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:28.471222 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d2cf713b-090f-403c-a150-74fafc05ec35 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:28.471892 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d2cf713b-090f-403c-a150-74fafc05ec35 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:28.472331 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d2cf713b-090f-403c-a150-74fafc05ec35 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:28.472738 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d2cf713b-090f-403c-a150-74fafc05ec35 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:28.602499 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-d2cf713b-090f-403c-a150-74fafc05ec35 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:28.611018 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d2cf713b-090f-403c-a150-74fafc05ec35 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1445 microversion: 2.1 time: 0.150774 Sep 06 22:46:28.611580 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 269/527] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:28 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1445 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:28.695653 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ecc5f91b-55d5-4fee-8695-b8e3f590a63f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:28.696273 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ecc5f91b-55d5-4fee-8695-b8e3f590a63f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:28.702419 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ecc5f91b-55d5-4fee-8695-b8e3f590a63f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:28.702902 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ecc5f91b-55d5-4fee-8695-b8e3f590a63f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:28.703336 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ecc5f91b-55d5-4fee-8695-b8e3f590a63f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:28.704191 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ecc5f91b-55d5-4fee-8695-b8e3f590a63f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:28.704710 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ecc5f91b-55d5-4fee-8695-b8e3f590a63f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:28.705400 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ecc5f91b-55d5-4fee-8695-b8e3f590a63f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:28.935121 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ecc5f91b-55d5-4fee-8695-b8e3f590a63f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:28.947860 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ecc5f91b-55d5-4fee-8695-b8e3f590a63f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1678 microversion: 2.1 time: 0.256083 Sep 06 22:46:28.948582 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 259/528] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:28 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1678 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:29.975588 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b03107b9-f693-422e-a601-2c4ab0f31e1f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:29.976857 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b03107b9-f693-422e-a601-2c4ab0f31e1f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:29.991321 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b03107b9-f693-422e-a601-2c4ab0f31e1f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:29.991817 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b03107b9-f693-422e-a601-2c4ab0f31e1f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:29.992250 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b03107b9-f693-422e-a601-2c4ab0f31e1f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:29.992995 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b03107b9-f693-422e-a601-2c4ab0f31e1f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:29.993447 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b03107b9-f693-422e-a601-2c4ab0f31e1f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:29.993864 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b03107b9-f693-422e-a601-2c4ab0f31e1f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:30.492081 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b03107b9-f693-422e-a601-2c4ab0f31e1f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:30.499658 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b03107b9-f693-422e-a601-2c4ab0f31e1f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1678 microversion: 2.1 time: 0.527984 Sep 06 22:46:30.500219 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 270/529] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:29 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1678 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:30.661320 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-1c8fb249-1333-4a35-9942-64c0cdc6b674 req-ca990645-4889-4453-aace-c5a885768fad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43a8e21a-339a-4ea5-ad07-4d74e92be9de", "tag": "1501f706-7e9c-4f45-b83a-b0e52d8d1f26"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:46:30.671268 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-1c8fb249-1333-4a35-9942-64c0cdc6b674 req-ca990645-4889-4453-aace-c5a885768fad service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:30.671817 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-1c8fb249-1333-4a35-9942-64c0cdc6b674 req-ca990645-4889-4453-aace-c5a885768fad service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:30.672308 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-1c8fb249-1333-4a35-9942-64c0cdc6b674 req-ca990645-4889-4453-aace-c5a885768fad service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:30.683961 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-1c8fb249-1333-4a35-9942-64c0cdc6b674 req-ca990645-4889-4453-aace-c5a885768fad service nova] Creating event network-changed:1501f706-7e9c-4f45-b83a-b0e52d8d1f26 for instance 43a8e21a-339a-4ea5-ad07-4d74e92be9de on hv-cinder-85220 Sep 06 22:46:30.690123 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-1c8fb249-1333-4a35-9942-64c0cdc6b674 req-ca990645-4889-4453-aace-c5a885768fad service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033123 Sep 06 22:46:30.690798 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 260/530] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:46:31.523305 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-8c85cc25-cee1-42c5-8281-b5cca71b1700 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:31.523909 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-8c85cc25-cee1-42c5-8281-b5cca71b1700 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:31.530469 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8c85cc25-cee1-42c5-8281-b5cca71b1700 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:31.530947 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8c85cc25-cee1-42c5-8281-b5cca71b1700 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:31.531374 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8c85cc25-cee1-42c5-8281-b5cca71b1700 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:31.532644 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8c85cc25-cee1-42c5-8281-b5cca71b1700 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:31.533127 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8c85cc25-cee1-42c5-8281-b5cca71b1700 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:31.533544 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8c85cc25-cee1-42c5-8281-b5cca71b1700 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:31.667192 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-8c85cc25-cee1-42c5-8281-b5cca71b1700 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:31.674771 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-8c85cc25-cee1-42c5-8281-b5cca71b1700 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1678 microversion: 2.1 time: 0.155593 Sep 06 22:46:31.675338 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 271/531] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:31 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:32.700138 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3ed1fca3-4c34-47b3-93d1-79b6c36ebf4d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:32.700875 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3ed1fca3-4c34-47b3-93d1-79b6c36ebf4d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:32.707899 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ed1fca3-4c34-47b3-93d1-79b6c36ebf4d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:32.708380 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ed1fca3-4c34-47b3-93d1-79b6c36ebf4d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:32.708845 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ed1fca3-4c34-47b3-93d1-79b6c36ebf4d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:32.709540 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ed1fca3-4c34-47b3-93d1-79b6c36ebf4d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:32.709989 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ed1fca3-4c34-47b3-93d1-79b6c36ebf4d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:32.710407 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3ed1fca3-4c34-47b3-93d1-79b6c36ebf4d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:32.847350 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3ed1fca3-4c34-47b3-93d1-79b6c36ebf4d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:32.855007 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3ed1fca3-4c34-47b3-93d1-79b6c36ebf4d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1678 microversion: 2.1 time: 0.161388 Sep 06 22:46:32.855571 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 261/532] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:32 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:33.878250 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9243ed87-46bc-44fa-a426-25d59200b8b5 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:33.878893 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9243ed87-46bc-44fa-a426-25d59200b8b5 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:33.885711 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9243ed87-46bc-44fa-a426-25d59200b8b5 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:33.886187 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9243ed87-46bc-44fa-a426-25d59200b8b5 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:33.886615 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9243ed87-46bc-44fa-a426-25d59200b8b5 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:33.887295 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9243ed87-46bc-44fa-a426-25d59200b8b5 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:33.887741 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9243ed87-46bc-44fa-a426-25d59200b8b5 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:33.888165 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9243ed87-46bc-44fa-a426-25d59200b8b5 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:34.012380 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9243ed87-46bc-44fa-a426-25d59200b8b5 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:34.014664 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:46:34.021818 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9243ed87-46bc-44fa-a426-25d59200b8b5 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1678 microversion: 2.1 time: 0.148112 Sep 06 22:46:34.022667 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 272/533] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:33 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:35.045990 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8d8da53e-1f88-48bc-939a-0a27ec78c652 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:35.046605 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8d8da53e-1f88-48bc-939a-0a27ec78c652 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:35.053891 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d8da53e-1f88-48bc-939a-0a27ec78c652 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:35.054372 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d8da53e-1f88-48bc-939a-0a27ec78c652 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:35.054812 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d8da53e-1f88-48bc-939a-0a27ec78c652 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:35.055556 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d8da53e-1f88-48bc-939a-0a27ec78c652 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:35.056246 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d8da53e-1f88-48bc-939a-0a27ec78c652 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:35.056716 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8d8da53e-1f88-48bc-939a-0a27ec78c652 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:35.189685 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8d8da53e-1f88-48bc-939a-0a27ec78c652 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:35.197799 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8d8da53e-1f88-48bc-939a-0a27ec78c652 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1678 microversion: 2.1 time: 0.155700 Sep 06 22:46:35.198383 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 262/534] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:35 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:36.084344 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-60393e24-a6e2-43af-9d93-c2595c4c3e24 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77ebcfbd-9b8e-419d-abfd-9e6537190a8c"}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:46:36.086812 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-60393e24-a6e2-43af-9d93-c2595c4c3e24 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:36.094500 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-60393e24-a6e2-43af-9d93-c2595c4c3e24 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:36.094982 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-60393e24-a6e2-43af-9d93-c2595c4c3e24 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:36.095416 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-60393e24-a6e2-43af-9d93-c2595c4c3e24 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:36.096669 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-60393e24-a6e2-43af-9d93-c2595c4c3e24 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:36.097160 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-60393e24-a6e2-43af-9d93-c2595c4c3e24 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:36.097579 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-60393e24-a6e2-43af-9d93-c2595c4c3e24 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:36.222021 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8568d732-0a08-4f54-8b47-3e2b248cf916 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:36.222628 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8568d732-0a08-4f54-8b47-3e2b248cf916 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:36.228947 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8568d732-0a08-4f54-8b47-3e2b248cf916 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:36.229422 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8568d732-0a08-4f54-8b47-3e2b248cf916 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:36.229844 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8568d732-0a08-4f54-8b47-3e2b248cf916 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:36.230521 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8568d732-0a08-4f54-8b47-3e2b248cf916 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:36.230961 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8568d732-0a08-4f54-8b47-3e2b248cf916 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:36.231372 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8568d732-0a08-4f54-8b47-3e2b248cf916 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:36.371729 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8568d732-0a08-4f54-8b47-3e2b248cf916 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:36.382490 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8568d732-0a08-4f54-8b47-3e2b248cf916 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1678 microversion: 2.1 time: 0.163712 Sep 06 22:46:36.383078 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 263/535] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:36 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:46:37.406479 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-10ff56e3-a0cf-4a74-b606-febbb8edebec tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:37.407112 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-10ff56e3-a0cf-4a74-b606-febbb8edebec tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:37.414084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-10ff56e3-a0cf-4a74-b606-febbb8edebec tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:37.414564 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-10ff56e3-a0cf-4a74-b606-febbb8edebec tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:37.414994 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-10ff56e3-a0cf-4a74-b606-febbb8edebec tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:37.415678 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-10ff56e3-a0cf-4a74-b606-febbb8edebec tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:37.416133 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-10ff56e3-a0cf-4a74-b606-febbb8edebec tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:37.416556 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-10ff56e3-a0cf-4a74-b606-febbb8edebec tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:37.545936 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-10ff56e3-a0cf-4a74-b606-febbb8edebec tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:37.554323 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-10ff56e3-a0cf-4a74-b606-febbb8edebec tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1678 microversion: 2.1 time: 0.151724 Sep 06 22:46:37.554900 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 264/536] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:37 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:38.577834 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f5a04a29-0d37-4356-b4bb-f97d5fff284e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:38.578436 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f5a04a29-0d37-4356-b4bb-f97d5fff284e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:38.585092 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f5a04a29-0d37-4356-b4bb-f97d5fff284e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:38.585570 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f5a04a29-0d37-4356-b4bb-f97d5fff284e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:38.585993 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f5a04a29-0d37-4356-b4bb-f97d5fff284e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:38.586671 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f5a04a29-0d37-4356-b4bb-f97d5fff284e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:38.587125 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f5a04a29-0d37-4356-b4bb-f97d5fff284e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:38.587528 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f5a04a29-0d37-4356-b4bb-f97d5fff284e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:38.717163 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f5a04a29-0d37-4356-b4bb-f97d5fff284e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:38.725555 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f5a04a29-0d37-4356-b4bb-f97d5fff284e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1678 microversion: 2.1 time: 0.151616 Sep 06 22:46:38.726135 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 265/537] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:38 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:46:38.988512 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-60393e24-a6e2-43af-9d93-c2595c4c3e24 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "POST /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.909120 Sep 06 22:46:38.989230 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 273/538] 10.222.0.39 () {60 vars in 1323 bytes} [Tue Sep 6 22:46:36 2022] POST /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d/os-volume_attachments => generated 194 bytes in 2911 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:46:39.749017 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6c24a87d-3646-491c-9bba-d17d79b096b5 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:39.749665 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6c24a87d-3646-491c-9bba-d17d79b096b5 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:39.756680 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c24a87d-3646-491c-9bba-d17d79b096b5 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:39.757151 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c24a87d-3646-491c-9bba-d17d79b096b5 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:39.757570 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c24a87d-3646-491c-9bba-d17d79b096b5 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:39.758313 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c24a87d-3646-491c-9bba-d17d79b096b5 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:39.758778 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c24a87d-3646-491c-9bba-d17d79b096b5 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:39.759181 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6c24a87d-3646-491c-9bba-d17d79b096b5 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:39.889180 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6c24a87d-3646-491c-9bba-d17d79b096b5 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:39.897786 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6c24a87d-3646-491c-9bba-d17d79b096b5 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1655 microversion: 2.1 time: 0.152416 Sep 06 22:46:39.898420 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 266/539] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:39 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1655 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:39.921389 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e8ce573e-5644-4275-a39a-ce02169a5764 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:46:39.928229 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e8ce573e-5644-4275-a39a-ce02169a5764 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:39.928720 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e8ce573e-5644-4275-a39a-ce02169a5764 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:39.929156 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e8ce573e-5644-4275-a39a-ce02169a5764 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:39.990083 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e8ce573e-5644-4275-a39a-ce02169a5764 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Going to try to start instance {{(pid=127087) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 06 22:46:40.033221 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e8ce573e-5644-4275-a39a-ce02169a5764 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "POST /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5/action" status: 202 len: 0 microversion: 2.1 time: 0.116272 Sep 06 22:46:40.034711 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 274/540] 10.222.0.39 () {60 vars in 1278 bytes} [Tue Sep 6 22:46:39 2022] POST /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 22:46:40.042965 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e3662df5-d317-4439-a1ec-9961c1117582 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:40.043575 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e3662df5-d317-4439-a1ec-9961c1117582 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:40.050774 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3662df5-d317-4439-a1ec-9961c1117582 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:40.051290 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3662df5-d317-4439-a1ec-9961c1117582 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:40.051724 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3662df5-d317-4439-a1ec-9961c1117582 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:40.052481 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3662df5-d317-4439-a1ec-9961c1117582 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:40.052953 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3662df5-d317-4439-a1ec-9961c1117582 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:40.053373 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3662df5-d317-4439-a1ec-9961c1117582 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:40.232085 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e3662df5-d317-4439-a1ec-9961c1117582 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:40.240361 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e3662df5-d317-4439-a1ec-9961c1117582 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1664 microversion: 2.1 time: 0.201254 Sep 06 22:46:40.240962 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 267/541] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:40 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1664 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:41.264749 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d858d333-622a-4941-be35-3223d0d8be19 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:41.266287 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-d858d333-622a-4941-be35-3223d0d8be19 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:41.274939 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d858d333-622a-4941-be35-3223d0d8be19 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:41.275423 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d858d333-622a-4941-be35-3223d0d8be19 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:41.275975 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d858d333-622a-4941-be35-3223d0d8be19 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:41.276666 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d858d333-622a-4941-be35-3223d0d8be19 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:41.277138 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d858d333-622a-4941-be35-3223d0d8be19 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:41.277548 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d858d333-622a-4941-be35-3223d0d8be19 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:41.411062 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-d858d333-622a-4941-be35-3223d0d8be19 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:41.418584 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d858d333-622a-4941-be35-3223d0d8be19 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1664 microversion: 2.1 time: 0.158700 Sep 06 22:46:41.419132 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 275/542] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:41 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1664 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:42.441799 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ba96e8ac-d680-414d-b739-87b93774f409 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:42.442323 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ba96e8ac-d680-414d-b739-87b93774f409 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:42.448613 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ba96e8ac-d680-414d-b739-87b93774f409 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:42.449127 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ba96e8ac-d680-414d-b739-87b93774f409 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:42.449565 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ba96e8ac-d680-414d-b739-87b93774f409 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:42.450248 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ba96e8ac-d680-414d-b739-87b93774f409 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:42.450698 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ba96e8ac-d680-414d-b739-87b93774f409 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:42.451120 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ba96e8ac-d680-414d-b739-87b93774f409 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:42.583177 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ba96e8ac-d680-414d-b739-87b93774f409 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:42.590754 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ba96e8ac-d680-414d-b739-87b93774f409 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1668 microversion: 2.1 time: 0.153627 Sep 06 22:46:42.591304 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 268/543] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:42 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1668 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:43.030904 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d60b97a0-0d63-49df-a00b-2fcdd7bf0e19 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:43.031413 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-d60b97a0-0d63-49df-a00b-2fcdd7bf0e19 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c396f306-9184-4575-9c97-3b0ef86a7d3d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:43.037900 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d60b97a0-0d63-49df-a00b-2fcdd7bf0e19 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:43.038372 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d60b97a0-0d63-49df-a00b-2fcdd7bf0e19 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:43.038791 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d60b97a0-0d63-49df-a00b-2fcdd7bf0e19 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:43.039459 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d60b97a0-0d63-49df-a00b-2fcdd7bf0e19 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:43.039895 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d60b97a0-0d63-49df-a00b-2fcdd7bf0e19 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:43.040318 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d60b97a0-0d63-49df-a00b-2fcdd7bf0e19 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:43.119237 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.objects.instance [None req-d60b97a0-0d63-49df-a00b-2fcdd7bf0e19 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lazy-loading 'services' on Instance uuid c396f306-9184-4575-9c97-3b0ef86a7d3d {{(pid=127087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 22:46:43.193516 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d60b97a0-0d63-49df-a00b-2fcdd7bf0e19 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d/os-volume_attachments/20131c96-cbbf-4e92-9569-08c7d0e978d8" status: 202 len: 0 microversion: 2.1 time: 0.166306 Sep 06 22:46:43.194104 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 276/544] 10.222.0.39 () {58 vars in 1416 bytes} [Tue Sep 6 22:46:43 2022] DELETE /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d/os-volume_attachments/20131c96-cbbf-4e92-9569-08c7d0e978d8 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 22:46:46.543548 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c1b31ece-aea5-4fdc-92df-3d46c4e2e282 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:46:46.545758 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c1b31ece-aea5-4fdc-92df-3d46c4e2e282 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:46.548374 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=68 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:46:46.554436 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c1b31ece-aea5-4fdc-92df-3d46c4e2e282 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:46.554919 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c1b31ece-aea5-4fdc-92df-3d46c4e2e282 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:46.555344 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c1b31ece-aea5-4fdc-92df-3d46c4e2e282 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:46.556031 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c1b31ece-aea5-4fdc-92df-3d46c4e2e282 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:46.556475 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c1b31ece-aea5-4fdc-92df-3d46c4e2e282 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:46.556914 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c1b31ece-aea5-4fdc-92df-3d46c4e2e282 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:46.579348 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-c1b31ece-aea5-4fdc-92df-3d46c4e2e282 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lazy-loading 'flavor' on Instance uuid 7b07b208-45e2-45aa-ad7b-bede527cfb6d {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 22:46:46.583345 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:46:46.701187 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c1b31ece-aea5-4fdc-92df-3d46c4e2e282 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "POST /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d/action" status: 200 len: 32 microversion: 2.1 time: 0.161526 Sep 06 22:46:46.701804 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 269/545] 10.222.0.39 () {60 vars in 1278 bytes} [Tue Sep 6 22:46:46 2022] POST /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d/action => generated 32 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 22:46:46.713994 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ed79717f-2f1d-4b40-9f66-349c4d9c757d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:46.715270 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ed79717f-2f1d-4b40-9f66-349c4d9c757d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:46.721669 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ed79717f-2f1d-4b40-9f66-349c4d9c757d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:46.722161 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ed79717f-2f1d-4b40-9f66-349c4d9c757d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:46.722780 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ed79717f-2f1d-4b40-9f66-349c4d9c757d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:46.723531 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ed79717f-2f1d-4b40-9f66-349c4d9c757d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:46.723981 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ed79717f-2f1d-4b40-9f66-349c4d9c757d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:46.724405 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ed79717f-2f1d-4b40-9f66-349c4d9c757d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:46.950313 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ed79717f-2f1d-4b40-9f66-349c4d9c757d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:46.958732 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ed79717f-2f1d-4b40-9f66-349c4d9c757d tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1737 microversion: 2.1 time: 0.250558 Sep 06 22:46:46.959308 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 277/546] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:46 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1737 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:47.492657 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f3d0c19a-e5f1-4708-bb89-043f4660f164 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:47.493270 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f3d0c19a-e5f1-4708-bb89-043f4660f164 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c396f306-9184-4575-9c97-3b0ef86a7d3d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:47.499472 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f3d0c19a-e5f1-4708-bb89-043f4660f164 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:47.499899 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f3d0c19a-e5f1-4708-bb89-043f4660f164 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:47.500340 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f3d0c19a-e5f1-4708-bb89-043f4660f164 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:47.501051 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f3d0c19a-e5f1-4708-bb89-043f4660f164 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:47.501506 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f3d0c19a-e5f1-4708-bb89-043f4660f164 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:47.501926 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f3d0c19a-e5f1-4708-bb89-043f4660f164 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:47.528056 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f3d0c19a-e5f1-4708-bb89-043f4660f164 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c396f306-9184-4575-9c97-3b0ef86a7d3d] Going to try to terminate instance {{(pid=127088) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 22:46:47.606289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f3d0c19a-e5f1-4708-bb89-043f4660f164 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d" status: 204 len: 0 microversion: 2.1 time: 0.117316 Sep 06 22:46:47.607175 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 270/547] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Sep 6 22:46:47 2022] DELETE /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 22:46:47.615852 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-8de2d033-a98a-4fe4-b3ac-e465c3598c63 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:47.616456 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-8de2d033-a98a-4fe4-b3ac-e465c3598c63 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c396f306-9184-4575-9c97-3b0ef86a7d3d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:47.622593 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8de2d033-a98a-4fe4-b3ac-e465c3598c63 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:47.623068 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8de2d033-a98a-4fe4-b3ac-e465c3598c63 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:47.623495 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8de2d033-a98a-4fe4-b3ac-e465c3598c63 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:47.624172 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8de2d033-a98a-4fe4-b3ac-e465c3598c63 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:47.624615 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8de2d033-a98a-4fe4-b3ac-e465c3598c63 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:47.625092 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8de2d033-a98a-4fe4-b3ac-e465c3598c63 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:47.760699 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-8de2d033-a98a-4fe4-b3ac-e465c3598c63 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8036279ef4384bdbfa8c37e46a1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebbea5186774c59942358c1fc284fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:47.768987 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-8de2d033-a98a-4fe4-b3ac-e465c3598c63 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d" status: 200 len: 1514 microversion: 2.1 time: 0.157368 Sep 06 22:46:47.769548 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 278/548] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:47 2022] GET /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:47.983025 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e328405a-e80c-4a9d-88c2-c68d8e09ccc4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:47.983721 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e328405a-e80c-4a9d-88c2-c68d8e09ccc4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:47.990058 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e328405a-e80c-4a9d-88c2-c68d8e09ccc4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:47.990536 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e328405a-e80c-4a9d-88c2-c68d8e09ccc4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:47.990968 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e328405a-e80c-4a9d-88c2-c68d8e09ccc4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:47.991650 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e328405a-e80c-4a9d-88c2-c68d8e09ccc4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:47.992095 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e328405a-e80c-4a9d-88c2-c68d8e09ccc4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:47.992517 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e328405a-e80c-4a9d-88c2-c68d8e09ccc4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:48.122752 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e328405a-e80c-4a9d-88c2-c68d8e09ccc4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:48.131532 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e328405a-e80c-4a9d-88c2-c68d8e09ccc4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1737 microversion: 2.1 time: 0.152830 Sep 06 22:46:48.132096 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 271/549] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:47 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:48.792459 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f4cbf1eb-daef-455c-9361-08f9a1309514 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:48.793078 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-f4cbf1eb-daef-455c-9361-08f9a1309514 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c396f306-9184-4575-9c97-3b0ef86a7d3d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:48.795467 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=52 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:46:48.801617 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f4cbf1eb-daef-455c-9361-08f9a1309514 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:48.802088 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f4cbf1eb-daef-455c-9361-08f9a1309514 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:48.802510 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f4cbf1eb-daef-455c-9361-08f9a1309514 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:48.803178 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f4cbf1eb-daef-455c-9361-08f9a1309514 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:48.803622 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f4cbf1eb-daef-455c-9361-08f9a1309514 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:48.804058 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f4cbf1eb-daef-455c-9361-08f9a1309514 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:48.932483 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-f4cbf1eb-daef-455c-9361-08f9a1309514 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8036279ef4384bdbfa8c37e46a1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebbea5186774c59942358c1fc284fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:48.940632 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-f4cbf1eb-daef-455c-9361-08f9a1309514 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d" status: 200 len: 1514 microversion: 2.1 time: 0.151502 Sep 06 22:46:48.941237 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 279/550] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:48 2022] GET /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:49.154489 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6f39cdc1-b217-423c-a42d-8d594807736f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:49.155018 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6f39cdc1-b217-423c-a42d-8d594807736f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:49.162239 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f39cdc1-b217-423c-a42d-8d594807736f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:49.162714 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f39cdc1-b217-423c-a42d-8d594807736f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:49.163137 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f39cdc1-b217-423c-a42d-8d594807736f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:49.163812 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f39cdc1-b217-423c-a42d-8d594807736f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:49.164255 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f39cdc1-b217-423c-a42d-8d594807736f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:49.164668 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f39cdc1-b217-423c-a42d-8d594807736f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:49.294312 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6f39cdc1-b217-423c-a42d-8d594807736f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:49.302466 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6f39cdc1-b217-423c-a42d-8d594807736f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1737 microversion: 2.1 time: 0.151923 Sep 06 22:46:49.303028 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 272/551] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:49 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:49.964799 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-2e0dda9d-e051-4e5b-b733-eb013b84c61f tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:49.965404 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-2e0dda9d-e051-4e5b-b733-eb013b84c61f tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c396f306-9184-4575-9c97-3b0ef86a7d3d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:49.972580 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2e0dda9d-e051-4e5b-b733-eb013b84c61f tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:49.973090 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2e0dda9d-e051-4e5b-b733-eb013b84c61f tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:49.973521 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2e0dda9d-e051-4e5b-b733-eb013b84c61f tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:49.974207 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2e0dda9d-e051-4e5b-b733-eb013b84c61f tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:49.974651 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2e0dda9d-e051-4e5b-b733-eb013b84c61f tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:49.975069 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2e0dda9d-e051-4e5b-b733-eb013b84c61f tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:50.109133 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-2e0dda9d-e051-4e5b-b733-eb013b84c61f tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8036279ef4384bdbfa8c37e46a1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebbea5186774c59942358c1fc284fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:50.117491 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-2e0dda9d-e051-4e5b-b733-eb013b84c61f tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d" status: 200 len: 1514 microversion: 2.1 time: 0.156797 Sep 06 22:46:50.118090 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 280/552] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:49 2022] GET /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:50.326093 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6601f196-81ac-4236-868f-7235dd52b3a1 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:50.326720 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6601f196-81ac-4236-868f-7235dd52b3a1 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:50.333587 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6601f196-81ac-4236-868f-7235dd52b3a1 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:50.334058 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6601f196-81ac-4236-868f-7235dd52b3a1 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:50.334481 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6601f196-81ac-4236-868f-7235dd52b3a1 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:50.335160 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6601f196-81ac-4236-868f-7235dd52b3a1 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:50.335607 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6601f196-81ac-4236-868f-7235dd52b3a1 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:50.336611 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6601f196-81ac-4236-868f-7235dd52b3a1 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:50.548077 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6601f196-81ac-4236-868f-7235dd52b3a1 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:50.556593 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6601f196-81ac-4236-868f-7235dd52b3a1 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1737 microversion: 2.1 time: 0.234277 Sep 06 22:46:50.558823 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 273/553] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:50 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1737 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:50.919715 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-2e553fe0-4239-48de-b454-9ed5d8c0bd37 req-09dac694-b513-4544-b8d1-74589555d56a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c396f306-9184-4575-9c97-3b0ef86a7d3d", "name": "network-vif-deleted", "tag": "75bdd4fe-9e1c-43fe-b117-ea174c811267"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:46:50.929264 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-2e553fe0-4239-48de-b454-9ed5d8c0bd37 req-09dac694-b513-4544-b8d1-74589555d56a service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:50.929736 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-2e553fe0-4239-48de-b454-9ed5d8c0bd37 req-09dac694-b513-4544-b8d1-74589555d56a service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:50.930159 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-2e553fe0-4239-48de-b454-9ed5d8c0bd37 req-09dac694-b513-4544-b8d1-74589555d56a service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:50.941117 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-2e553fe0-4239-48de-b454-9ed5d8c0bd37 req-09dac694-b513-4544-b8d1-74589555d56a service nova] Creating event network-vif-deleted:75bdd4fe-9e1c-43fe-b117-ea174c811267 for instance c396f306-9184-4575-9c97-3b0ef86a7d3d on hv-cinder-85220 Sep 06 22:46:50.946206 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-2e553fe0-4239-48de-b454-9ed5d8c0bd37 req-09dac694-b513-4544-b8d1-74589555d56a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030208 Sep 06 22:46:50.946809 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 281/554] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:46:51.140849 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b178f375-67a5-4415-88ea-67e37a4d5056 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:51.141452 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b178f375-67a5-4415-88ea-67e37a4d5056 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c396f306-9184-4575-9c97-3b0ef86a7d3d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:51.147443 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b178f375-67a5-4415-88ea-67e37a4d5056 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:51.148171 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b178f375-67a5-4415-88ea-67e37a4d5056 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:51.148596 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b178f375-67a5-4415-88ea-67e37a4d5056 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:51.149314 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b178f375-67a5-4415-88ea-67e37a4d5056 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:51.149763 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b178f375-67a5-4415-88ea-67e37a4d5056 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:51.150173 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b178f375-67a5-4415-88ea-67e37a4d5056 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:51.184177 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b178f375-67a5-4415-88ea-67e37a4d5056 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:51.184652 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b178f375-67a5-4415-88ea-67e37a4d5056 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:51.185174 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b178f375-67a5-4415-88ea-67e37a4d5056 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:51.185516 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-b178f375-67a5-4415-88ea-67e37a4d5056 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lazy-loading 'fault' on Instance uuid c396f306-9184-4575-9c97-3b0ef86a7d3d {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 22:46:51.226853 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b178f375-67a5-4415-88ea-67e37a4d5056 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d8036279ef4384bdbfa8c37e46a1d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebbea5186774c59942358c1fc284fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:51.234702 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b178f375-67a5-4415-88ea-67e37a4d5056 tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d" status: 200 len: 1309 microversion: 2.1 time: 0.097945 Sep 06 22:46:51.235252 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 274/555] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:51 2022] GET /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:51.581603 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-91512746-2d8f-4035-af26-17baf5f3a3d3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:51.582283 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-91512746-2d8f-4035-af26-17baf5f3a3d3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:51.588867 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-91512746-2d8f-4035-af26-17baf5f3a3d3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:51.589340 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-91512746-2d8f-4035-af26-17baf5f3a3d3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:51.589760 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-91512746-2d8f-4035-af26-17baf5f3a3d3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:51.590429 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-91512746-2d8f-4035-af26-17baf5f3a3d3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:51.590870 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-91512746-2d8f-4035-af26-17baf5f3a3d3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:51.591280 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-91512746-2d8f-4035-af26-17baf5f3a3d3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:51.737232 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-91512746-2d8f-4035-af26-17baf5f3a3d3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:51.745379 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-91512746-2d8f-4035-af26-17baf5f3a3d3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1737 microversion: 2.1 time: 0.167917 Sep 06 22:46:51.745945 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 282/556] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:51 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:52.258611 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b65e919f-4162-4f01-bb3e-9faae0be3f4d tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:52.259214 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b65e919f-4162-4f01-bb3e-9faae0be3f4d tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] [instance: c396f306-9184-4575-9c97-3b0ef86a7d3d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:52.265534 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b65e919f-4162-4f01-bb3e-9faae0be3f4d tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:52.266016 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b65e919f-4162-4f01-bb3e-9faae0be3f4d tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:52.266447 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b65e919f-4162-4f01-bb3e-9faae0be3f4d tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:52.267176 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b65e919f-4162-4f01-bb3e-9faae0be3f4d tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:52.267622 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b65e919f-4162-4f01-bb3e-9faae0be3f4d tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:52.268569 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b65e919f-4162-4f01-bb3e-9faae0be3f4d tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:52.282596 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-b65e919f-4162-4f01-bb3e-9faae0be3f4d tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] HTTP exception thrown: Instance c396f306-9184-4575-9c97-3b0ef86a7d3d could not be found. Sep 06 22:46:52.284386 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b65e919f-4162-4f01-bb3e-9faae0be3f4d tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Request method failure captured: Sep 06 22:46:52.284386 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d HTTP/1.1 Sep 06 22:46:52.284386 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept: application/json Sep 06 22:46:52.284386 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Sep 06 22:46:52.284386 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Connection: close Sep 06 22:46:52.284386 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Length: 0 Sep 06 22:46:52.284386 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Type: application/json Sep 06 22:46:52.284386 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Host: 10.222.0.39 Sep 06 22:46:52.284386 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Sep 06 22:46:52.284386 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Sep 06 22:46:52.284386 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjF81N1UqyK-rk9BoRTUUq9BjoECvFuklBW8kgntIrYOIyqHy7jyt5eNCIvoZHe_o4u9a7fN1qFNe3NipLkHKkM6qUdat8sxmb_95GdCIN599ImF3GDaQvIWdM3FuBetJw6cMT6G-19v2okgMPHj-9XIRgAWnEU-5D1wMjxInMtnkmG9Y Sep 06 22:46:52.284386 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Sep 06 22:46:52.284386 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Sep 06 22:46:52.284386 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Sep 06 22:46:52.284386 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Sep 06 22:46:52.284386 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Sep 06 22:46:52.284386 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Sep 06 22:46:52.284386 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Id: 3ebbea5186774c59942358c1fc284fa7 Sep 06 22:46:52.284386 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-VolumesSnapshotTestJSON-426490102 Sep 06 22:46:52.284386 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Role: reader,member Sep 06 22:46:52.284386 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Sep 06 22:46:52.285835 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3ebbea5186774c59942358c1fc284fa7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3ebbea5186774c59942358c1fc284fa7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3ebbea5186774c59942358c1fc284fa7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3ebbea5186774c59942358c1fc284fa7"}]}] Sep 06 22:46:52.285835 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-VolumesSnapshotTestJSON-426490102 Sep 06 22:46:52.285835 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 3ebbea5186774c59942358c1fc284fa7 Sep 06 22:46:52.285835 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-426490102 Sep 06 22:46:52.285835 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User: tempest-VolumesSnapshotTestJSON-426490102-project Sep 06 22:46:52.285835 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Sep 06 22:46:52.285835 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Sep 06 22:46:52.285835 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Id: 81d8036279ef4384bdbfa8c37e46a1d6 Sep 06 22:46:52.285835 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-VolumesSnapshotTestJSON-426490102-project Sep 06 22:46:52.285835 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: method: > Sep 06 22:46:52.285835 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: exception: Instance c396f306-9184-4575-9c97-3b0ef86a7d3d could not be found. Sep 06 22:46:52.285835 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: action_args: {'id': 'c396f306-9184-4575-9c97-3b0ef86a7d3d'} Sep 06 22:46:52.286568 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:46:52.286568 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:46:52.286568 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:46:52.286568 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:46:52.286568 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:46:52.286568 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:46:52.286568 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:46:52.286568 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:46:52.286568 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:46:52.286568 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:46:52.286568 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c396f306-9184-4575-9c97-3b0ef86a7d3d could not be found. Sep 06 22:46:52.286568 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:46:52.286568 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:46:52.286568 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:46:52.286568 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:46:52.286568 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:46:52.286568 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:46:52.286568 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:46:52.286568 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:46:52.286568 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:46:52.287782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:46:52.287782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 22:46:52.287782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 22:46:52.287782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:46:52.287782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:46:52.287782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:46:52.287782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:46:52.287782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c396f306-9184-4575-9c97-3b0ef86a7d3d could not be found. Sep 06 22:46:52.287782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:46:52.287782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:46:52.287782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:46:52.287782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:46:52.287782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:46:52.287782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:46:52.287782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:46:52.287782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:46:52.287782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c396f306-9184-4575-9c97-3b0ef86a7d3d could not be found. Sep 06 22:46:52.287782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:46:52.288916 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b65e919f-4162-4f01-bb3e-9faae0be3f4d tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] Returning 404 to user: Instance c396f306-9184-4575-9c97-3b0ef86a7d3d could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:46:52.288916 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b65e919f-4162-4f01-bb3e-9faae0be3f4d tempest-VolumesSnapshotTestJSON-426490102 tempest-VolumesSnapshotTestJSON-426490102-project] 10.222.0.39 "GET /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d" status: 404 len: 111 microversion: 2.1 time: 0.031134 Sep 06 22:46:52.288916 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 275/557] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:52 2022] GET /compute/v2.1/servers/c396f306-9184-4575-9c97-3b0ef86a7d3d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 22:46:52.770496 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-3a9482a9-5daa-4f8a-a92b-e2c19da6d9f9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:52.771272 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-3a9482a9-5daa-4f8a-a92b-e2c19da6d9f9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:52.778719 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3a9482a9-5daa-4f8a-a92b-e2c19da6d9f9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:52.779194 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3a9482a9-5daa-4f8a-a92b-e2c19da6d9f9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:52.779619 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3a9482a9-5daa-4f8a-a92b-e2c19da6d9f9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:52.780302 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3a9482a9-5daa-4f8a-a92b-e2c19da6d9f9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:52.780746 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3a9482a9-5daa-4f8a-a92b-e2c19da6d9f9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:52.781181 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3a9482a9-5daa-4f8a-a92b-e2c19da6d9f9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:52.912125 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3a9482a9-5daa-4f8a-a92b-e2c19da6d9f9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:52.920247 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-3a9482a9-5daa-4f8a-a92b-e2c19da6d9f9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1737 microversion: 2.1 time: 0.155068 Sep 06 22:46:52.920827 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 283/558] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:52 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:53.943743 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a840e54b-d5f3-4d30-9ccd-03c9b67d7140 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:53.944393 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a840e54b-d5f3-4d30-9ccd-03c9b67d7140 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:53.950925 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a840e54b-d5f3-4d30-9ccd-03c9b67d7140 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:53.951415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a840e54b-d5f3-4d30-9ccd-03c9b67d7140 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:53.951853 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a840e54b-d5f3-4d30-9ccd-03c9b67d7140 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:53.952548 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a840e54b-d5f3-4d30-9ccd-03c9b67d7140 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:53.953105 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a840e54b-d5f3-4d30-9ccd-03c9b67d7140 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:53.953532 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a840e54b-d5f3-4d30-9ccd-03c9b67d7140 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:54.079217 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a840e54b-d5f3-4d30-9ccd-03c9b67d7140 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:54.088007 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a840e54b-d5f3-4d30-9ccd-03c9b67d7140 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1737 microversion: 2.1 time: 0.148459 Sep 06 22:46:54.088566 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 276/559] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:53 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:55.111595 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ffcc69e5-b291-48df-b856-e00830f30bb5 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:55.112879 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ffcc69e5-b291-48df-b856-e00830f30bb5 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:55.120148 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ffcc69e5-b291-48df-b856-e00830f30bb5 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:55.120623 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ffcc69e5-b291-48df-b856-e00830f30bb5 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:55.121094 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ffcc69e5-b291-48df-b856-e00830f30bb5 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:55.121774 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ffcc69e5-b291-48df-b856-e00830f30bb5 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:55.122214 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ffcc69e5-b291-48df-b856-e00830f30bb5 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:55.122623 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ffcc69e5-b291-48df-b856-e00830f30bb5 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:55.271237 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ffcc69e5-b291-48df-b856-e00830f30bb5 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:55.275335 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ffcc69e5-b291-48df-b856-e00830f30bb5 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1737 microversion: 2.1 time: 0.167681 Sep 06 22:46:55.275901 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 284/560] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:55 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:46:56.300483 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-37a8cda9-e7fb-4a99-b256-6f65b7e8643a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:56.301114 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-37a8cda9-e7fb-4a99-b256-6f65b7e8643a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:56.307491 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-37a8cda9-e7fb-4a99-b256-6f65b7e8643a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:56.307970 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-37a8cda9-e7fb-4a99-b256-6f65b7e8643a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:56.308401 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-37a8cda9-e7fb-4a99-b256-6f65b7e8643a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:56.309119 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-37a8cda9-e7fb-4a99-b256-6f65b7e8643a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:56.309569 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-37a8cda9-e7fb-4a99-b256-6f65b7e8643a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:56.309983 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-37a8cda9-e7fb-4a99-b256-6f65b7e8643a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:56.440519 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-37a8cda9-e7fb-4a99-b256-6f65b7e8643a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:56.449969 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-37a8cda9-e7fb-4a99-b256-6f65b7e8643a tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1737 microversion: 2.1 time: 0.153828 Sep 06 22:46:56.450535 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 277/561] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:56 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:57.473540 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9aaa9729-a8ad-42db-8564-1cf5af5c12e0 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:57.474164 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9aaa9729-a8ad-42db-8564-1cf5af5c12e0 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:57.480577 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9aaa9729-a8ad-42db-8564-1cf5af5c12e0 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:57.481077 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9aaa9729-a8ad-42db-8564-1cf5af5c12e0 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:57.481503 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9aaa9729-a8ad-42db-8564-1cf5af5c12e0 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:57.482172 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9aaa9729-a8ad-42db-8564-1cf5af5c12e0 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:57.482615 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9aaa9729-a8ad-42db-8564-1cf5af5c12e0 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:57.483025 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9aaa9729-a8ad-42db-8564-1cf5af5c12e0 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:57.608341 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9aaa9729-a8ad-42db-8564-1cf5af5c12e0 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:57.617271 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9aaa9729-a8ad-42db-8564-1cf5af5c12e0 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1737 microversion: 2.1 time: 0.148129 Sep 06 22:46:57.617831 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 285/562] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:57 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:46:58.641099 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e20a072a-9673-4758-b0e4-93d240702bcc tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:58.641702 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e20a072a-9673-4758-b0e4-93d240702bcc tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:58.648597 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e20a072a-9673-4758-b0e4-93d240702bcc tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:58.649149 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e20a072a-9673-4758-b0e4-93d240702bcc tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:58.649553 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e20a072a-9673-4758-b0e4-93d240702bcc tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:58.650235 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e20a072a-9673-4758-b0e4-93d240702bcc tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:58.650684 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e20a072a-9673-4758-b0e4-93d240702bcc tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:58.651101 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e20a072a-9673-4758-b0e4-93d240702bcc tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:58.792827 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e20a072a-9673-4758-b0e4-93d240702bcc tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:58.801716 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e20a072a-9673-4758-b0e4-93d240702bcc tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1737 microversion: 2.1 time: 0.164620 Sep 06 22:46:58.802301 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 278/563] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:58 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:46:59.825313 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f72d504b-1a08-44a4-890e-f9026bb3aa85 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:46:59.825936 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-f72d504b-1a08-44a4-890e-f9026bb3aa85 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:46:59.833524 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f72d504b-1a08-44a4-890e-f9026bb3aa85 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:59.833940 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f72d504b-1a08-44a4-890e-f9026bb3aa85 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:59.834391 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f72d504b-1a08-44a4-890e-f9026bb3aa85 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:59.835067 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f72d504b-1a08-44a4-890e-f9026bb3aa85 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:46:59.835512 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f72d504b-1a08-44a4-890e-f9026bb3aa85 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:46:59.835926 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f72d504b-1a08-44a4-890e-f9026bb3aa85 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:46:59.964767 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-f72d504b-1a08-44a4-890e-f9026bb3aa85 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:46:59.973019 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-f72d504b-1a08-44a4-890e-f9026bb3aa85 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1737 microversion: 2.1 time: 0.151533 Sep 06 22:46:59.973582 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 286/564] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:46:59 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:47:00.995901 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-48a7dc23-2060-456e-bfef-89e8ced8c82e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:00.996464 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-48a7dc23-2060-456e-bfef-89e8ced8c82e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:01.003049 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-48a7dc23-2060-456e-bfef-89e8ced8c82e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:01.003423 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-48a7dc23-2060-456e-bfef-89e8ced8c82e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:01.003857 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-48a7dc23-2060-456e-bfef-89e8ced8c82e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:01.004543 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-48a7dc23-2060-456e-bfef-89e8ced8c82e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:01.005025 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-48a7dc23-2060-456e-bfef-89e8ced8c82e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:01.005449 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-48a7dc23-2060-456e-bfef-89e8ced8c82e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:01.135645 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-48a7dc23-2060-456e-bfef-89e8ced8c82e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:01.144297 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-48a7dc23-2060-456e-bfef-89e8ced8c82e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1737 microversion: 2.1 time: 0.152669 Sep 06 22:47:01.144874 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 279/565] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:47:00 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:47:02.168659 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9926a971-ba6d-4191-bbd0-78cc16ce2431 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:02.169293 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9926a971-ba6d-4191-bbd0-78cc16ce2431 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:02.175914 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9926a971-ba6d-4191-bbd0-78cc16ce2431 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:02.176420 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9926a971-ba6d-4191-bbd0-78cc16ce2431 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:02.176879 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9926a971-ba6d-4191-bbd0-78cc16ce2431 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:02.177566 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9926a971-ba6d-4191-bbd0-78cc16ce2431 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:02.178014 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9926a971-ba6d-4191-bbd0-78cc16ce2431 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:02.178449 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9926a971-ba6d-4191-bbd0-78cc16ce2431 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:02.182461 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:47:02.309937 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9926a971-ba6d-4191-bbd0-78cc16ce2431 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:02.318750 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9926a971-ba6d-4191-bbd0-78cc16ce2431 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1737 microversion: 2.1 time: 0.154005 Sep 06 22:47:02.319353 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 287/566] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:47:02 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:47:03.341869 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f9abf777-2bac-4a2b-9b72-2bb83f81cfb3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:03.342400 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f9abf777-2bac-4a2b-9b72-2bb83f81cfb3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:03.349640 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9abf777-2bac-4a2b-9b72-2bb83f81cfb3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:03.350122 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9abf777-2bac-4a2b-9b72-2bb83f81cfb3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:03.350562 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9abf777-2bac-4a2b-9b72-2bb83f81cfb3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:03.351253 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9abf777-2bac-4a2b-9b72-2bb83f81cfb3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:03.351704 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9abf777-2bac-4a2b-9b72-2bb83f81cfb3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:03.352124 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f9abf777-2bac-4a2b-9b72-2bb83f81cfb3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:03.479798 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f9abf777-2bac-4a2b-9b72-2bb83f81cfb3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:03.487902 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f9abf777-2bac-4a2b-9b72-2bb83f81cfb3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1737 microversion: 2.1 time: 0.149983 Sep 06 22:47:03.488469 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 280/567] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:47:03 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:47:04.510530 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9f499374-86cd-4d86-a98d-b282660ba514 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:04.511132 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9f499374-86cd-4d86-a98d-b282660ba514 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:04.517477 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9f499374-86cd-4d86-a98d-b282660ba514 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:04.517948 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9f499374-86cd-4d86-a98d-b282660ba514 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:04.518371 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9f499374-86cd-4d86-a98d-b282660ba514 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:04.519039 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9f499374-86cd-4d86-a98d-b282660ba514 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:04.519480 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9f499374-86cd-4d86-a98d-b282660ba514 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:04.520370 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9f499374-86cd-4d86-a98d-b282660ba514 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:04.650002 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9f499374-86cd-4d86-a98d-b282660ba514 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:04.657970 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9f499374-86cd-4d86-a98d-b282660ba514 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1737 microversion: 2.1 time: 0.151324 Sep 06 22:47:04.658525 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 288/568] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:47:04 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:47:05.681881 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-11125425-49f6-4999-a2d6-a59cc1c15220 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:05.682484 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-11125425-49f6-4999-a2d6-a59cc1c15220 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:05.688943 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11125425-49f6-4999-a2d6-a59cc1c15220 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:05.689414 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11125425-49f6-4999-a2d6-a59cc1c15220 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:05.689836 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11125425-49f6-4999-a2d6-a59cc1c15220 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:05.690508 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11125425-49f6-4999-a2d6-a59cc1c15220 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:05.690981 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11125425-49f6-4999-a2d6-a59cc1c15220 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:05.691391 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-11125425-49f6-4999-a2d6-a59cc1c15220 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:05.820054 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-11125425-49f6-4999-a2d6-a59cc1c15220 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:05.828357 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-11125425-49f6-4999-a2d6-a59cc1c15220 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1737 microversion: 2.1 time: 0.150277 Sep 06 22:47:05.828883 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 281/569] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:47:05 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:47:06.852154 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a8023d54-ac84-4dd2-82d7-47c15edfa7a9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:06.852868 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-a8023d54-ac84-4dd2-82d7-47c15edfa7a9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:06.859413 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a8023d54-ac84-4dd2-82d7-47c15edfa7a9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:06.859910 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a8023d54-ac84-4dd2-82d7-47c15edfa7a9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:06.860334 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a8023d54-ac84-4dd2-82d7-47c15edfa7a9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:06.861040 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a8023d54-ac84-4dd2-82d7-47c15edfa7a9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:06.861482 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a8023d54-ac84-4dd2-82d7-47c15edfa7a9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:06.861906 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a8023d54-ac84-4dd2-82d7-47c15edfa7a9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:06.990146 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-a8023d54-ac84-4dd2-82d7-47c15edfa7a9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:06.998256 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-a8023d54-ac84-4dd2-82d7-47c15edfa7a9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1737 microversion: 2.1 time: 0.150722 Sep 06 22:47:06.998814 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 289/570] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:47:06 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:47:08.021729 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-078dcfe8-6070-4b41-b2e7-674d10ffe0ed tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:08.022334 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-078dcfe8-6070-4b41-b2e7-674d10ffe0ed tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:08.029000 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-078dcfe8-6070-4b41-b2e7-674d10ffe0ed tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:08.029480 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-078dcfe8-6070-4b41-b2e7-674d10ffe0ed tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:08.029909 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-078dcfe8-6070-4b41-b2e7-674d10ffe0ed tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:08.030595 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-078dcfe8-6070-4b41-b2e7-674d10ffe0ed tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:08.031041 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-078dcfe8-6070-4b41-b2e7-674d10ffe0ed tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:08.031461 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-078dcfe8-6070-4b41-b2e7-674d10ffe0ed tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:08.160064 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-078dcfe8-6070-4b41-b2e7-674d10ffe0ed tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:08.169128 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-078dcfe8-6070-4b41-b2e7-674d10ffe0ed tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1737 microversion: 2.1 time: 0.151250 Sep 06 22:47:08.169691 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 282/571] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:47:08 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:47:09.193146 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9e6ece3c-56cf-435d-945f-bdd5cdffd0ae tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:09.193743 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9e6ece3c-56cf-435d-945f-bdd5cdffd0ae tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:09.200106 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9e6ece3c-56cf-435d-945f-bdd5cdffd0ae tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:09.200580 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9e6ece3c-56cf-435d-945f-bdd5cdffd0ae tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:09.201038 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9e6ece3c-56cf-435d-945f-bdd5cdffd0ae tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:09.201708 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9e6ece3c-56cf-435d-945f-bdd5cdffd0ae tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:09.202150 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9e6ece3c-56cf-435d-945f-bdd5cdffd0ae tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:09.202560 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9e6ece3c-56cf-435d-945f-bdd5cdffd0ae tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:09.331516 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9e6ece3c-56cf-435d-945f-bdd5cdffd0ae tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:09.339606 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9e6ece3c-56cf-435d-945f-bdd5cdffd0ae tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1717 microversion: 2.1 time: 0.150882 Sep 06 22:47:09.340161 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 290/572] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:47:09 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1717 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:47:09.449757 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2c5353bb-6392-4325-9c8f-187af4ed3f69 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:09.450246 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2c5353bb-6392-4325-9c8f-187af4ed3f69 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:09.456596 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2c5353bb-6392-4325-9c8f-187af4ed3f69 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:09.457103 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2c5353bb-6392-4325-9c8f-187af4ed3f69 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:09.457529 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2c5353bb-6392-4325-9c8f-187af4ed3f69 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:09.458202 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2c5353bb-6392-4325-9c8f-187af4ed3f69 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:09.458643 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2c5353bb-6392-4325-9c8f-187af4ed3f69 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:09.459056 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2c5353bb-6392-4325-9c8f-187af4ed3f69 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:09.462840 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:47:09.539330 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-2c5353bb-6392-4325-9c8f-187af4ed3f69 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] HTTP exception thrown: Cannot 'detach_volume' instance 7b07b208-45e2-45aa-ad7b-bede527cfb6d while it is in vm_state rescued Sep 06 22:47:09.540783 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2c5353bb-6392-4325-9c8f-187af4ed3f69 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Request method failure captured: Sep 06 22:47:09.540783 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: request: DELETE /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d/os-volume_attachments/77ebcfbd-9b8e-419d-abfd-9e6537190a8c HTTP/1.1 Sep 06 22:47:09.540783 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept: application/json Sep 06 22:47:09.540783 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Sep 06 22:47:09.540783 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Connection: close Sep 06 22:47:09.540783 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Length: 0 Sep 06 22:47:09.540783 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Type: application/json Sep 06 22:47:09.540783 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Host: 10.222.0.39 Sep 06 22:47:09.540783 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Sep 06 22:47:09.540783 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Sep 06 22:47:09.540783 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjF8zr3ZzLjA2gwI7YEUt9cbBvmbp_x4ePSTIy-YRHBGO1km1XYQsyRXo1bKQtaluJ7IZzwPTYhu0Q2-OK1qDco29jAZu8GJ0xy8vIJ8lATrAGg8YhLEoTAMLN9QKkngqWKdXs7keDyDgD2zskPjbWbA9c5uX7NbZdbQA8YqfAuMZMfA0 Sep 06 22:47:09.540783 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Sep 06 22:47:09.540783 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Sep 06 22:47:09.540783 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Sep 06 22:47:09.540783 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Sep 06 22:47:09.540783 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Sep 06 22:47:09.540783 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Sep 06 22:47:09.540783 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Id: 84c39ea86193481fa08158197629ea85 Sep 06 22:47:09.540783 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1404608848 Sep 06 22:47:09.540783 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Role: reader,member Sep 06 22:47:09.540783 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Sep 06 22:47:09.542423 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/84c39ea86193481fa08158197629ea85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_84c39ea86193481fa08158197629ea85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/84c39ea86193481fa08158197629ea85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/84c39ea86193481fa08158197629ea85"}]}] Sep 06 22:47:09.542423 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1404608848 Sep 06 22:47:09.542423 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 84c39ea86193481fa08158197629ea85 Sep 06 22:47:09.542423 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1404608848 Sep 06 22:47:09.542423 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User: tempest-ServerRescueNegativeTestJSON-1404608848-project Sep 06 22:47:09.542423 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Sep 06 22:47:09.542423 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Sep 06 22:47:09.542423 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Id: 2945d87f1c114dd0b42c4e58a8133e76 Sep 06 22:47:09.542423 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1404608848-project Sep 06 22:47:09.542423 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: method: > Sep 06 22:47:09.542423 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: exception: Cannot 'detach_volume' instance 7b07b208-45e2-45aa-ad7b-bede527cfb6d while it is in vm_state rescued Sep 06 22:47:09.543245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: action_args: {'server_id': '7b07b208-45e2-45aa-ad7b-bede527cfb6d', 'id': '77ebcfbd-9b8e-419d-abfd-9e6537190a8c'} Sep 06 22:47:09.543245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:47:09.543245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:47:09.543245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 06 22:47:09.543245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 06 22:47:09.543245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 22:47:09.543245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 22:47:09.543245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 06 22:47:09.543245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 06 22:47:09.543245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7b07b208-45e2-45aa-ad7b-bede527cfb6d in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 06 22:47:09.543245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:47:09.543245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:47:09.543245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:47:09.543245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:47:09.543245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:47:09.543245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:47:09.543245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:47:09.543245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:47:09.543245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:47:09.543245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:47:09.544809 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 06 22:47:09.544809 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 06 22:47:09.544809 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 06 22:47:09.544809 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 06 22:47:09.544809 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 7b07b208-45e2-45aa-ad7b-bede527cfb6d while it is in vm_state rescued Sep 06 22:47:09.544809 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:47:09.544809 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:47:09.544809 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:47:09.544809 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:47:09.544809 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:47:09.544809 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:47:09.544809 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:47:09.544809 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:47:09.544809 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 7b07b208-45e2-45aa-ad7b-bede527cfb6d while it is in vm_state rescued Sep 06 22:47:09.544809 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:47:09.544809 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2c5353bb-6392-4325-9c8f-187af4ed3f69 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Returning 409 to user: Cannot 'detach_volume' instance 7b07b208-45e2-45aa-ad7b-bede527cfb6d while it is in vm_state rescued {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:47:09.546059 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2c5353bb-6392-4325-9c8f-187af4ed3f69 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d/os-volume_attachments/77ebcfbd-9b8e-419d-abfd-9e6537190a8c" status: 409 len: 152 microversion: 2.1 time: 0.096404 Sep 06 22:47:09.546059 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 283/573] 10.222.0.39 () {58 vars in 1416 bytes} [Tue Sep 6 22:47:09 2022] DELETE /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d/os-volume_attachments/77ebcfbd-9b8e-419d-abfd-9e6537190a8c => generated 152 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 06 22:47:09.551070 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-53729e68-556b-4dac-8ae6-8d7529dcef76 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:47:09.552362 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-53729e68-556b-4dac-8ae6-8d7529dcef76 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:09.558307 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-53729e68-556b-4dac-8ae6-8d7529dcef76 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:09.558786 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-53729e68-556b-4dac-8ae6-8d7529dcef76 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:09.559233 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-53729e68-556b-4dac-8ae6-8d7529dcef76 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:09.559902 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-53729e68-556b-4dac-8ae6-8d7529dcef76 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:09.560345 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-53729e68-556b-4dac-8ae6-8d7529dcef76 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:09.560821 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-53729e68-556b-4dac-8ae6-8d7529dcef76 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:09.627497 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-53729e68-556b-4dac-8ae6-8d7529dcef76 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "POST /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d/action" status: 202 len: 0 microversion: 2.1 time: 0.080126 Sep 06 22:47:09.628492 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 291/574] 10.222.0.39 () {60 vars in 1278 bytes} [Tue Sep 6 22:47:09 2022] POST /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 22:47:09.637096 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0846a50a-d7f5-4026-8820-c0740f811b2e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:09.637827 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0846a50a-d7f5-4026-8820-c0740f811b2e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:09.643715 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0846a50a-d7f5-4026-8820-c0740f811b2e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:09.644203 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0846a50a-d7f5-4026-8820-c0740f811b2e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:09.644627 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0846a50a-d7f5-4026-8820-c0740f811b2e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:09.645947 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0846a50a-d7f5-4026-8820-c0740f811b2e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:09.646500 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0846a50a-d7f5-4026-8820-c0740f811b2e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:09.646915 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0846a50a-d7f5-4026-8820-c0740f811b2e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:09.887380 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0846a50a-d7f5-4026-8820-c0740f811b2e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:09.896082 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0846a50a-d7f5-4026-8820-c0740f811b2e tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1725 microversion: 2.1 time: 0.262943 Sep 06 22:47:09.896653 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 284/575] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:47:09 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1725 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:47:10.920501 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-fddf6807-ee7a-405e-8faa-d3289b8ec42f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:10.921222 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-fddf6807-ee7a-405e-8faa-d3289b8ec42f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:10.929257 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fddf6807-ee7a-405e-8faa-d3289b8ec42f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:10.929522 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fddf6807-ee7a-405e-8faa-d3289b8ec42f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:10.929810 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fddf6807-ee7a-405e-8faa-d3289b8ec42f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:10.930494 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fddf6807-ee7a-405e-8faa-d3289b8ec42f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:10.930938 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fddf6807-ee7a-405e-8faa-d3289b8ec42f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:10.931352 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fddf6807-ee7a-405e-8faa-d3289b8ec42f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:11.072655 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-fddf6807-ee7a-405e-8faa-d3289b8ec42f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:11.081087 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-fddf6807-ee7a-405e-8faa-d3289b8ec42f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1725 microversion: 2.1 time: 0.165328 Sep 06 22:47:11.081667 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 292/576] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:47:10 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:47:12.104786 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-59fbe19f-5447-45f3-ba7d-61a17f023c01 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:12.105403 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-59fbe19f-5447-45f3-ba7d-61a17f023c01 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:12.112713 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59fbe19f-5447-45f3-ba7d-61a17f023c01 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:12.113279 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59fbe19f-5447-45f3-ba7d-61a17f023c01 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:12.113718 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59fbe19f-5447-45f3-ba7d-61a17f023c01 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:12.122607 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59fbe19f-5447-45f3-ba7d-61a17f023c01 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:12.122607 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59fbe19f-5447-45f3-ba7d-61a17f023c01 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:12.122607 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-59fbe19f-5447-45f3-ba7d-61a17f023c01 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:12.244099 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-59fbe19f-5447-45f3-ba7d-61a17f023c01 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:12.252603 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-59fbe19f-5447-45f3-ba7d-61a17f023c01 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1725 microversion: 2.1 time: 0.151865 Sep 06 22:47:12.253202 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 285/577] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:47:12 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:47:13.276367 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6659f4cf-094e-45e0-ad94-ddd785f53831 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:13.276894 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-6659f4cf-094e-45e0-ad94-ddd785f53831 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:13.283192 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6659f4cf-094e-45e0-ad94-ddd785f53831 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:13.283666 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6659f4cf-094e-45e0-ad94-ddd785f53831 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:13.284090 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6659f4cf-094e-45e0-ad94-ddd785f53831 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:13.284807 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6659f4cf-094e-45e0-ad94-ddd785f53831 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:13.285248 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6659f4cf-094e-45e0-ad94-ddd785f53831 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:13.285659 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6659f4cf-094e-45e0-ad94-ddd785f53831 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:13.433265 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6659f4cf-094e-45e0-ad94-ddd785f53831 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:13.442542 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-6659f4cf-094e-45e0-ad94-ddd785f53831 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1731 microversion: 2.1 time: 0.170038 Sep 06 22:47:13.443627 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 293/578] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:47:13 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:47:13.466525 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-062a8711-2dfb-483a-92e6-4582d2a01259 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:13.467005 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-062a8711-2dfb-483a-92e6-4582d2a01259 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:13.473367 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-062a8711-2dfb-483a-92e6-4582d2a01259 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:13.473842 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-062a8711-2dfb-483a-92e6-4582d2a01259 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:13.474813 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-062a8711-2dfb-483a-92e6-4582d2a01259 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:13.475517 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-062a8711-2dfb-483a-92e6-4582d2a01259 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:13.475965 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-062a8711-2dfb-483a-92e6-4582d2a01259 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:13.476390 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-062a8711-2dfb-483a-92e6-4582d2a01259 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:13.551956 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-062a8711-2dfb-483a-92e6-4582d2a01259 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089288 Sep 06 22:47:13.553559 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 286/579] 10.222.0.39 () {58 vars in 1275 bytes} [Tue Sep 6 22:47:13 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:47:14.739058 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-567680d2-ebbc-412e-a375-350bb6a02dbe req-6965aa7a-c1ef-40d4-8def-5833b9d81236 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b07b208-45e2-45aa-ad7b-bede527cfb6d", "tag": "bc5d6b1f-b033-4efc-ac9f-ff0f920a565c"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:47:14.753793 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-567680d2-ebbc-412e-a375-350bb6a02dbe req-6965aa7a-c1ef-40d4-8def-5833b9d81236 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:14.754721 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-567680d2-ebbc-412e-a375-350bb6a02dbe req-6965aa7a-c1ef-40d4-8def-5833b9d81236 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:14.755623 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-567680d2-ebbc-412e-a375-350bb6a02dbe req-6965aa7a-c1ef-40d4-8def-5833b9d81236 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:14.773035 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-567680d2-ebbc-412e-a375-350bb6a02dbe req-6965aa7a-c1ef-40d4-8def-5833b9d81236 service nova] Creating event network-changed:bc5d6b1f-b033-4efc-ac9f-ff0f920a565c for instance 7b07b208-45e2-45aa-ad7b-bede527cfb6d on hv-cinder-85220 Sep 06 22:47:14.779377 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-567680d2-ebbc-412e-a375-350bb6a02dbe req-6965aa7a-c1ef-40d4-8def-5833b9d81236 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044054 Sep 06 22:47:14.779982 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 294/580] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:47:16.796544 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-3c3f3b98-28c3-47e5-8090-2e176688e371 req-b760fe96-fccb-4abf-b509-6dc727c449a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b07b208-45e2-45aa-ad7b-bede527cfb6d", "tag": "bc5d6b1f-b033-4efc-ac9f-ff0f920a565c"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:47:16.801915 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:47:16.808205 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-3c3f3b98-28c3-47e5-8090-2e176688e371 req-b760fe96-fccb-4abf-b509-6dc727c449a9 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:16.808670 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-3c3f3b98-28c3-47e5-8090-2e176688e371 req-b760fe96-fccb-4abf-b509-6dc727c449a9 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:16.809124 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-3c3f3b98-28c3-47e5-8090-2e176688e371 req-b760fe96-fccb-4abf-b509-6dc727c449a9 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:16.821958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-3c3f3b98-28c3-47e5-8090-2e176688e371 req-b760fe96-fccb-4abf-b509-6dc727c449a9 service nova] Creating event network-changed:bc5d6b1f-b033-4efc-ac9f-ff0f920a565c for instance 7b07b208-45e2-45aa-ad7b-bede527cfb6d on hv-cinder-85220 Sep 06 22:47:16.827265 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-3c3f3b98-28c3-47e5-8090-2e176688e371 req-b760fe96-fccb-4abf-b509-6dc727c449a9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034277 Sep 06 22:47:16.827847 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 287/581] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:47:18.722763 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9b271d0c-5697-4c0a-b926-12e294d462c7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:18.723338 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9b271d0c-5697-4c0a-b926-12e294d462c7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:18.730269 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9b271d0c-5697-4c0a-b926-12e294d462c7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:18.730741 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9b271d0c-5697-4c0a-b926-12e294d462c7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:18.731168 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9b271d0c-5697-4c0a-b926-12e294d462c7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:18.731841 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9b271d0c-5697-4c0a-b926-12e294d462c7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:18.732285 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9b271d0c-5697-4c0a-b926-12e294d462c7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:18.732705 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9b271d0c-5697-4c0a-b926-12e294d462c7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:18.762993 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9b271d0c-5697-4c0a-b926-12e294d462c7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd/os-volume_attachments/b2193943-2848-49ef-a0ca-fe997883994e" status: 200 len: 194 microversion: 2.20 time: 0.045028 Sep 06 22:47:18.763754 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 295/582] 10.222.0.39 () {60 vars in 1454 bytes} [Tue Sep 6 22:47:18 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd/os-volume_attachments/b2193943-2848-49ef-a0ca-fe997883994e => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 22:47:18.835363 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-61c691c7-a20b-458d-8e74-461c90cc25bd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:18.835920 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-61c691c7-a20b-458d-8e74-461c90cc25bd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:18.842004 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-61c691c7-a20b-458d-8e74-461c90cc25bd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:18.842481 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-61c691c7-a20b-458d-8e74-461c90cc25bd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:18.842910 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-61c691c7-a20b-458d-8e74-461c90cc25bd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:18.843596 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-61c691c7-a20b-458d-8e74-461c90cc25bd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:18.844050 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-61c691c7-a20b-458d-8e74-461c90cc25bd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:18.844468 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-61c691c7-a20b-458d-8e74-461c90cc25bd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:18.928887 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-61c691c7-a20b-458d-8e74-461c90cc25bd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lazy-loading 'services' on Instance uuid 13ef5db2-b5d1-41af-8c93-2851abb0b6dd {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 22:47:18.998605 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-61c691c7-a20b-458d-8e74-461c90cc25bd tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "DELETE /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd/os-volume_attachments/b2193943-2848-49ef-a0ca-fe997883994e" status: 202 len: 0 microversion: 2.20 time: 0.168138 Sep 06 22:47:18.999192 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 288/583] 10.222.0.39 () {60 vars in 1457 bytes} [Tue Sep 6 22:47:18 2022] DELETE /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd/os-volume_attachments/b2193943-2848-49ef-a0ca-fe997883994e => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 22:47:19.008100 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9eaf6633-674b-4bfe-a8b7-250797000473 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:19.010284 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9eaf6633-674b-4bfe-a8b7-250797000473 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:19.012219 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=34 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:47:19.017613 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9eaf6633-674b-4bfe-a8b7-250797000473 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:19.018093 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9eaf6633-674b-4bfe-a8b7-250797000473 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:19.020204 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9eaf6633-674b-4bfe-a8b7-250797000473 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:19.020970 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9eaf6633-674b-4bfe-a8b7-250797000473 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:19.021426 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9eaf6633-674b-4bfe-a8b7-250797000473 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:19.021847 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9eaf6633-674b-4bfe-a8b7-250797000473 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:19.055598 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9eaf6633-674b-4bfe-a8b7-250797000473 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052035 Sep 06 22:47:19.056159 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 296/584] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Sep 6 22:47:19 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 22:47:20.070231 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ac586f1e-44ee-44f0-ae72-ab39d59a84aa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:20.072568 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ac586f1e-44ee-44f0-ae72-ab39d59a84aa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:20.078716 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac586f1e-44ee-44f0-ae72-ab39d59a84aa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:20.079196 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac586f1e-44ee-44f0-ae72-ab39d59a84aa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:20.079631 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac586f1e-44ee-44f0-ae72-ab39d59a84aa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:20.080318 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac586f1e-44ee-44f0-ae72-ab39d59a84aa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:20.080787 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac586f1e-44ee-44f0-ae72-ab39d59a84aa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:20.081207 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac586f1e-44ee-44f0-ae72-ab39d59a84aa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:20.110360 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ac586f1e-44ee-44f0-ae72-ab39d59a84aa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045616 Sep 06 22:47:20.110912 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 289/585] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Sep 6 22:47:20 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:47:20.177293 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f3003b54-c2cc-4be9-b490-1d8343c66716 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:20.178202 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-f3003b54-c2cc-4be9-b490-1d8343c66716 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:20.184383 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f3003b54-c2cc-4be9-b490-1d8343c66716 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:20.184884 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f3003b54-c2cc-4be9-b490-1d8343c66716 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:20.185310 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f3003b54-c2cc-4be9-b490-1d8343c66716 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:20.185986 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f3003b54-c2cc-4be9-b490-1d8343c66716 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:20.186422 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f3003b54-c2cc-4be9-b490-1d8343c66716 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:20.186831 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f3003b54-c2cc-4be9-b490-1d8343c66716 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:20.212330 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-f3003b54-c2cc-4be9-b490-1d8343c66716 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Going to try to terminate instance {{(pid=127087) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 22:47:20.291735 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-f3003b54-c2cc-4be9-b490-1d8343c66716 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "DELETE /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 204 len: 0 microversion: 2.20 time: 0.118004 Sep 06 22:47:20.292612 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 297/586] 10.222.0.39 () {60 vars in 1280 bytes} [Tue Sep 6 22:47:20 2022] DELETE /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 22:47:20.301897 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-047e8219-b2a6-4062-a2dd-2d940936c822 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:20.303259 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-047e8219-b2a6-4062-a2dd-2d940936c822 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:20.309230 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-047e8219-b2a6-4062-a2dd-2d940936c822 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:20.309710 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-047e8219-b2a6-4062-a2dd-2d940936c822 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:20.310142 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-047e8219-b2a6-4062-a2dd-2d940936c822 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:20.310901 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-047e8219-b2a6-4062-a2dd-2d940936c822 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:20.311346 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-047e8219-b2a6-4062-a2dd-2d940936c822 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:20.311763 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-047e8219-b2a6-4062-a2dd-2d940936c822 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:20.443857 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-047e8219-b2a6-4062-a2dd-2d940936c822 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:20.452986 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-047e8219-b2a6-4062-a2dd-2d940936c822 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:20.454485 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-047e8219-b2a6-4062-a2dd-2d940936c822 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:20.455658 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-047e8219-b2a6-4062-a2dd-2d940936c822 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1723 microversion: 2.20 time: 0.158303 Sep 06 22:47:20.456217 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 290/587] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:47:20 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:47:21.481286 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a434d0cb-f5df-492e-9e37-9d93733d3354 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:21.482015 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-a434d0cb-f5df-492e-9e37-9d93733d3354 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:21.488354 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a434d0cb-f5df-492e-9e37-9d93733d3354 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:21.488852 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a434d0cb-f5df-492e-9e37-9d93733d3354 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:21.489283 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a434d0cb-f5df-492e-9e37-9d93733d3354 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:21.490326 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a434d0cb-f5df-492e-9e37-9d93733d3354 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:21.490581 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a434d0cb-f5df-492e-9e37-9d93733d3354 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:21.490990 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a434d0cb-f5df-492e-9e37-9d93733d3354 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:21.621153 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-a434d0cb-f5df-492e-9e37-9d93733d3354 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:21.629137 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-a434d0cb-f5df-492e-9e37-9d93733d3354 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:21.631166 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-a434d0cb-f5df-492e-9e37-9d93733d3354 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:21.632332 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-a434d0cb-f5df-492e-9e37-9d93733d3354 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1723 microversion: 2.20 time: 0.155495 Sep 06 22:47:21.632887 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 298/588] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:47:21 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:47:22.659279 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-144664dd-2fd6-47b0-ac9c-fcd5ec4ec85d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:22.659876 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-144664dd-2fd6-47b0-ac9c-fcd5ec4ec85d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:22.667668 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-144664dd-2fd6-47b0-ac9c-fcd5ec4ec85d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:22.668393 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-144664dd-2fd6-47b0-ac9c-fcd5ec4ec85d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:22.668854 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-144664dd-2fd6-47b0-ac9c-fcd5ec4ec85d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:22.669557 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-144664dd-2fd6-47b0-ac9c-fcd5ec4ec85d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:22.670005 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-144664dd-2fd6-47b0-ac9c-fcd5ec4ec85d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:22.670423 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-144664dd-2fd6-47b0-ac9c-fcd5ec4ec85d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:22.755544 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-144664dd-2fd6-47b0-ac9c-fcd5ec4ec85d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:22.765069 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-144664dd-2fd6-47b0-ac9c-fcd5ec4ec85d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:22.766572 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-144664dd-2fd6-47b0-ac9c-fcd5ec4ec85d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:22.767778 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-144664dd-2fd6-47b0-ac9c-fcd5ec4ec85d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1655 microversion: 2.20 time: 0.112537 Sep 06 22:47:22.768357 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 291/589] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:47:22 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1655 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:47:23.027952 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-6b689dfe-254d-43f2-8b08-70a4b712a6e0 req-53a5e249-4ac5-4e5e-8b49-63cefcd82a92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13ef5db2-b5d1-41af-8c93-2851abb0b6dd", "name": "network-vif-deleted", "tag": "2130f481-0970-42ca-bbc5-20da06de6a04"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:47:23.037612 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-6b689dfe-254d-43f2-8b08-70a4b712a6e0 req-53a5e249-4ac5-4e5e-8b49-63cefcd82a92 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:23.038279 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-6b689dfe-254d-43f2-8b08-70a4b712a6e0 req-53a5e249-4ac5-4e5e-8b49-63cefcd82a92 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:23.038844 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-6b689dfe-254d-43f2-8b08-70a4b712a6e0 req-53a5e249-4ac5-4e5e-8b49-63cefcd82a92 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:23.055983 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-6b689dfe-254d-43f2-8b08-70a4b712a6e0 req-53a5e249-4ac5-4e5e-8b49-63cefcd82a92 service nova] Creating event network-vif-deleted:2130f481-0970-42ca-bbc5-20da06de6a04 for instance 13ef5db2-b5d1-41af-8c93-2851abb0b6dd on hv-cinder-85220 Sep 06 22:47:23.063180 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-6b689dfe-254d-43f2-8b08-70a4b712a6e0 req-53a5e249-4ac5-4e5e-8b49-63cefcd82a92 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038418 Sep 06 22:47:23.064301 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 299/590] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:47:23.795053 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4b016dc6-25fc-4746-a9d4-9657a1d23deb tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:23.796462 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4b016dc6-25fc-4746-a9d4-9657a1d23deb tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:23.805112 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4b016dc6-25fc-4746-a9d4-9657a1d23deb tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:23.805838 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4b016dc6-25fc-4746-a9d4-9657a1d23deb tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:23.806430 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4b016dc6-25fc-4746-a9d4-9657a1d23deb tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:23.807302 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4b016dc6-25fc-4746-a9d4-9657a1d23deb tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:23.807918 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4b016dc6-25fc-4746-a9d4-9657a1d23deb tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:23.808332 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4b016dc6-25fc-4746-a9d4-9657a1d23deb tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:23.845751 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4b016dc6-25fc-4746-a9d4-9657a1d23deb tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:23.846228 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4b016dc6-25fc-4746-a9d4-9657a1d23deb tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:23.846654 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4b016dc6-25fc-4746-a9d4-9657a1d23deb tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:23.847098 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-4b016dc6-25fc-4746-a9d4-9657a1d23deb tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lazy-loading 'fault' on Instance uuid 13ef5db2-b5d1-41af-8c93-2851abb0b6dd {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 22:47:23.905059 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4b016dc6-25fc-4746-a9d4-9657a1d23deb tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:23.913861 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4b016dc6-25fc-4746-a9d4-9657a1d23deb tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:23.915721 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4b016dc6-25fc-4746-a9d4-9657a1d23deb tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:23.917016 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4b016dc6-25fc-4746-a9d4-9657a1d23deb tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 200 len: 1371 microversion: 2.20 time: 0.126419 Sep 06 22:47:23.917592 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 292/591] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:47:23 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 1371 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:47:24.943525 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b9ddff09-b25b-454a-ba84-7876dc5f4ffa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:24.944159 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b9ddff09-b25b-454a-ba84-7876dc5f4ffa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:24.950818 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b9ddff09-b25b-454a-ba84-7876dc5f4ffa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:24.951289 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b9ddff09-b25b-454a-ba84-7876dc5f4ffa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:24.951717 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b9ddff09-b25b-454a-ba84-7876dc5f4ffa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:24.952408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b9ddff09-b25b-454a-ba84-7876dc5f4ffa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:24.952882 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b9ddff09-b25b-454a-ba84-7876dc5f4ffa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:24.953337 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b9ddff09-b25b-454a-ba84-7876dc5f4ffa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:24.970027 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-b9ddff09-b25b-454a-ba84-7876dc5f4ffa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] HTTP exception thrown: Instance 13ef5db2-b5d1-41af-8c93-2851abb0b6dd could not be found. Sep 06 22:47:24.971667 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b9ddff09-b25b-454a-ba84-7876dc5f4ffa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Request method failure captured: Sep 06 22:47:24.971667 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: request: GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd HTTP/1.1 Sep 06 22:47:24.971667 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept: application/json Sep 06 22:47:24.971667 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Sep 06 22:47:24.971667 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Connection: close Sep 06 22:47:24.971667 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Length: 0 Sep 06 22:47:24.971667 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Type: application/json Sep 06 22:47:24.971667 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Host: 10.222.0.39 Sep 06 22:47:24.971667 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Sep 06 22:47:24.971667 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.12 Sep 06 22:47:24.971667 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABjF8zxwkObdcihdnMhfWv34KEq2z7aSE5SpstG059ijv5K4rQE_9vulC_t_gkfYKiZO44rYtsO3GnMW5bVaedMWSSsblZu5IiDZGkWjmE8ib-1xzFx9XFQOkldzg32LgfG0WnR1hA6nHPzXmywGbJMpXG1I7XbiAyjfzzKJJIpMYoRLHc Sep 06 22:47:24.971667 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Sep 06 22:47:24.971667 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Sep 06 22:47:24.971667 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Sep 06 22:47:24.971667 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Sep 06 22:47:24.971667 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 22:47:24.971667 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Sep 06 22:47:24.971667 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Sep 06 22:47:24.971667 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Id: 38bf7d2d331a472c9d517f3c3067f58e Sep 06 22:47:24.971667 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-702816689 Sep 06 22:47:24.971667 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Role: reader,member Sep 06 22:47:24.971667 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Sep 06 22:47:24.973425 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38bf7d2d331a472c9d517f3c3067f58e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38bf7d2d331a472c9d517f3c3067f58e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38bf7d2d331a472c9d517f3c3067f58e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38bf7d2d331a472c9d517f3c3067f58e"}]}] Sep 06 22:47:24.973425 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-AttachVolumeShelveTestJSON-702816689 Sep 06 22:47:24.973425 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 38bf7d2d331a472c9d517f3c3067f58e Sep 06 22:47:24.973425 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-702816689 Sep 06 22:47:24.973425 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User: tempest-AttachVolumeShelveTestJSON-702816689-project Sep 06 22:47:24.973425 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Sep 06 22:47:24.973425 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Sep 06 22:47:24.973425 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Id: e305e7d0cbfc4aeca6164685d0155475 Sep 06 22:47:24.973425 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-AttachVolumeShelveTestJSON-702816689-project Sep 06 22:47:24.973425 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: method: > Sep 06 22:47:24.973425 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: exception: Instance 13ef5db2-b5d1-41af-8c93-2851abb0b6dd could not be found. Sep 06 22:47:24.973425 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: action_args: {'id': '13ef5db2-b5d1-41af-8c93-2851abb0b6dd'} Sep 06 22:47:24.975125 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:47:24.975125 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:47:24.975125 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:47:24.975125 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:47:24.975125 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:47:24.975125 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:47:24.975125 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:47:24.975125 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:47:24.975125 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:47:24.975125 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:47:24.975125 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13ef5db2-b5d1-41af-8c93-2851abb0b6dd could not be found. Sep 06 22:47:24.975125 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:47:24.975125 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:47:24.975125 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:47:24.975125 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:47:24.975125 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:47:24.975125 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:47:24.975125 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:47:24.975125 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:47:24.975125 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:47:24.976565 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:47:24.976565 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 22:47:24.976565 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 22:47:24.976565 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:47:24.976565 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:47:24.976565 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:47:24.976565 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:47:24.976565 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13ef5db2-b5d1-41af-8c93-2851abb0b6dd could not be found. Sep 06 22:47:24.976565 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:47:24.976565 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:47:24.976565 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:47:24.976565 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:47:24.976565 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:47:24.976565 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:47:24.976565 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:47:24.976565 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:47:24.976565 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13ef5db2-b5d1-41af-8c93-2851abb0b6dd could not be found. Sep 06 22:47:24.976565 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:47:24.977959 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b9ddff09-b25b-454a-ba84-7876dc5f4ffa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Returning 404 to user: Instance 13ef5db2-b5d1-41af-8c93-2851abb0b6dd could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:47:24.977959 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b9ddff09-b25b-454a-ba84-7876dc5f4ffa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 404 len: 111 microversion: 2.20 time: 0.034024 Sep 06 22:47:24.977959 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 300/592] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:47:24 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 22:47:24.983095 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9a0ba52e-6b0a-4714-9f41-1e932e975fd4 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '.version_select at 0x7f9c4f6f8ee0>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:25.005530 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9a0ba52e-6b0a-4714-9f41-1e932e975fd4 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1368608679" status: 204 len: 0 microversion: 2.20 time: 0.025367 Sep 06 22:47:25.006379 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 293/593] 10.222.0.39 () {60 vars in 1262 bytes} [Tue Sep 6 22:47:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1368608679 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 22:47:25.907618 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9fbae575-1659-494b-9fe3-d7f1e049ec80 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Action: 'create', calling method: .version_select at 0x7f9c52fc2700>, body: {"keypair": {"name": "tempest-keypair-1243742494", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVJz9VRHk5uTB4aCJc3SZspWrpUxX1Rb4SrxIz+wR5ElKpWajeFVti2Nw/2xIE9gEfX7Jt3JStC/QOspbFgB51AOa91Oc69Dk+pfuKBGX4206BAZppaZ4Uwg2bleAq3mg=="}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:47:25.923343 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-9fbae575-1659-494b-9fe3-d7f1e049ec80 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Getting quotas for project 38bf7d2d331a472c9d517f3c3067f58e. Resources: {'key_pairs'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 22:47:25.927166 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-9fbae575-1659-494b-9fe3-d7f1e049ec80 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Getting quotas for user e305e7d0cbfc4aeca6164685d0155475 and project 38bf7d2d331a472c9d517f3c3067f58e. Resources: {'key_pairs'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 22:47:25.954894 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9fbae575-1659-494b-9fe3-d7f1e049ec80 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.051295 Sep 06 22:47:25.955581 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 301/594] 10.222.0.39 () {62 vars in 1200 bytes} [Tue Sep 6 22:47:25 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 06 22:47:27.223973 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a201ae10-1355-48ab-92de-7b70d2144910 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-468544970", "imageRef": "93326d5e-4826-431e-9ad1-6ee2d44e48d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "54ce4610-272a-4a71-a77c-bd38eccb62b7"}], "security_groups": [{"name": "tempest-securitygroup--1493152600"}], "key_name": "tempest-keypair-1243742494", "user_data": "}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:47:27.325549 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.network.neutron [None req-a201ae10-1355-48ab-92de-7b70d2144910 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] validate_networks() for [('54ce4610-272a-4a71-a77c-bd38eccb62b7', None, None, None, None, None)] {{(pid=127088) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 22:47:27.685848 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-a201ae10-1355-48ab-92de-7b70d2144910 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Flavor limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 22:47:27.686388 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-a201ae10-1355-48ab-92de-7b70d2144910 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Image limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 22:47:27.686871 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-a201ae10-1355-48ab-92de-7b70d2144910 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Flavor pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 22:47:27.687283 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-a201ae10-1355-48ab-92de-7b70d2144910 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Image pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 22:47:27.687692 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-a201ae10-1355-48ab-92de-7b70d2144910 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 22:47:27.697321 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a201ae10-1355-48ab-92de-7b70d2144910 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:27.697802 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a201ae10-1355-48ab-92de-7b70d2144910 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:27.698235 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a201ae10-1355-48ab-92de-7b70d2144910 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:27.698966 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a201ae10-1355-48ab-92de-7b70d2144910 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:27.699417 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a201ae10-1355-48ab-92de-7b70d2144910 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:27.699839 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a201ae10-1355-48ab-92de-7b70d2144910 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:27.716993 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-a201ae10-1355-48ab-92de-7b70d2144910 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Getting quotas for project 38bf7d2d331a472c9d517f3c3067f58e. Resources: {'instances', 'ram', 'cores'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 22:47:27.720930 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-a201ae10-1355-48ab-92de-7b70d2144910 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Getting quotas for user e305e7d0cbfc4aeca6164685d0155475 and project 38bf7d2d331a472c9d517f3c3067f58e. Resources: {'instances', 'ram', 'cores'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 22:47:27.731855 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a201ae10-1355-48ab-92de-7b70d2144910 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Going to run 1 instances... {{(pid=127088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 22:47:27.734168 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a201ae10-1355-48ab-92de-7b70d2144910 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='93326d5e-4826-431e-9ad1-6ee2d44e48d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 22:47:27.782667 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a201ae10-1355-48ab-92de-7b70d2144910 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.563447 Sep 06 22:47:27.783315 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 294/595] 10.222.0.39 () {62 vars in 1188 bytes} [Tue Sep 6 22:47:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 06 22:47:27.795458 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-787edf7e-6201-4483-a0b1-1afd9b79b752 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:27.796061 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-787edf7e-6201-4483-a0b1-1afd9b79b752 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:27.857242 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-787edf7e-6201-4483-a0b1-1afd9b79b752 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:27.865012 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-787edf7e-6201-4483-a0b1-1afd9b79b752 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:27.866483 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-787edf7e-6201-4483-a0b1-1afd9b79b752 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:27.867557 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-787edf7e-6201-4483-a0b1-1afd9b79b752 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1281 microversion: 2.20 time: 0.076511 Sep 06 22:47:27.868097 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 302/596] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:47:27 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1281 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:47:28.893091 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f38245c9-fc60-4768-ad8e-089d03d6ec68 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:28.893675 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f38245c9-fc60-4768-ad8e-089d03d6ec68 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:28.900696 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f38245c9-fc60-4768-ad8e-089d03d6ec68 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:28.901196 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f38245c9-fc60-4768-ad8e-089d03d6ec68 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:28.901683 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f38245c9-fc60-4768-ad8e-089d03d6ec68 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:28.902364 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f38245c9-fc60-4768-ad8e-089d03d6ec68 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:28.902809 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f38245c9-fc60-4768-ad8e-089d03d6ec68 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:28.903224 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f38245c9-fc60-4768-ad8e-089d03d6ec68 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:28.969888 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f38245c9-fc60-4768-ad8e-089d03d6ec68 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:28.976648 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-52a88bc5-9aeb-4913-a3d9-0eb9a3b8503d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:28.978858 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-52a88bc5-9aeb-4913-a3d9-0eb9a3b8503d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:28.981505 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f38245c9-fc60-4768-ad8e-089d03d6ec68 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:28.982975 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f38245c9-fc60-4768-ad8e-089d03d6ec68 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:28.984909 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-52a88bc5-9aeb-4913-a3d9-0eb9a3b8503d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:28.985394 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-52a88bc5-9aeb-4913-a3d9-0eb9a3b8503d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:28.985821 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-52a88bc5-9aeb-4913-a3d9-0eb9a3b8503d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:28.986509 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f38245c9-fc60-4768-ad8e-089d03d6ec68 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1333 microversion: 2.20 time: 0.096581 Sep 06 22:47:28.986973 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-52a88bc5-9aeb-4913-a3d9-0eb9a3b8503d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:28.987465 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 295/597] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:47:28 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1333 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:47:28.987613 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-52a88bc5-9aeb-4913-a3d9-0eb9a3b8503d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:28.988032 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-52a88bc5-9aeb-4913-a3d9-0eb9a3b8503d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:29.019208 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-52a88bc5-9aeb-4913-a3d9-0eb9a3b8503d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047351 Sep 06 22:47:29.019940 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 303/598] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Sep 6 22:47:28 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 06 22:47:29.098124 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-35c47faf-af75-4cff-bfff-1fc7c07df132 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:29.098958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-35c47faf-af75-4cff-bfff-1fc7c07df132 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:29.105620 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35c47faf-af75-4cff-bfff-1fc7c07df132 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:29.106103 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35c47faf-af75-4cff-bfff-1fc7c07df132 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:29.106709 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35c47faf-af75-4cff-bfff-1fc7c07df132 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:29.107403 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35c47faf-af75-4cff-bfff-1fc7c07df132 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:29.107914 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35c47faf-af75-4cff-bfff-1fc7c07df132 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:29.108337 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35c47faf-af75-4cff-bfff-1fc7c07df132 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:29.138676 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-35c47faf-af75-4cff-bfff-1fc7c07df132 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Going to try to terminate instance {{(pid=127088) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 22:47:29.221693 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-35c47faf-af75-4cff-bfff-1fc7c07df132 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 204 len: 0 microversion: 2.1 time: 0.127359 Sep 06 22:47:29.222258 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 296/599] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Sep 6 22:47:29 2022] DELETE /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 22:47:29.230954 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a80e9e9e-f365-4caa-b477-48b8e5fee06e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:29.231551 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-a80e9e9e-f365-4caa-b477-48b8e5fee06e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:29.237541 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a80e9e9e-f365-4caa-b477-48b8e5fee06e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:29.238007 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a80e9e9e-f365-4caa-b477-48b8e5fee06e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:29.238431 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a80e9e9e-f365-4caa-b477-48b8e5fee06e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:29.239101 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a80e9e9e-f365-4caa-b477-48b8e5fee06e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:29.239534 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a80e9e9e-f365-4caa-b477-48b8e5fee06e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:29.240862 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a80e9e9e-f365-4caa-b477-48b8e5fee06e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:29.442662 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-a80e9e9e-f365-4caa-b477-48b8e5fee06e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:29.452260 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-a80e9e9e-f365-4caa-b477-48b8e5fee06e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1674 microversion: 2.1 time: 0.225009 Sep 06 22:47:29.452848 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 304/600] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:47:29 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1674 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:47:30.016668 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9e1b87fa-7bf8-4e3b-91e3-01dd0027ebca tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:30.017494 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9e1b87fa-7bf8-4e3b-91e3-01dd0027ebca tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:30.025149 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9e1b87fa-7bf8-4e3b-91e3-01dd0027ebca tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:30.025645 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9e1b87fa-7bf8-4e3b-91e3-01dd0027ebca tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:30.026080 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9e1b87fa-7bf8-4e3b-91e3-01dd0027ebca tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:30.026781 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9e1b87fa-7bf8-4e3b-91e3-01dd0027ebca tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:30.027233 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9e1b87fa-7bf8-4e3b-91e3-01dd0027ebca tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:30.027653 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9e1b87fa-7bf8-4e3b-91e3-01dd0027ebca tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:30.163644 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9e1b87fa-7bf8-4e3b-91e3-01dd0027ebca tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:30.171695 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9e1b87fa-7bf8-4e3b-91e3-01dd0027ebca tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:30.173195 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9e1b87fa-7bf8-4e3b-91e3-01dd0027ebca tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:30.174307 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9e1b87fa-7bf8-4e3b-91e3-01dd0027ebca tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1407 microversion: 2.20 time: 0.162203 Sep 06 22:47:30.174870 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 297/601] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:47:30 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:47:30.475776 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ac7da023-37d9-4bbf-91f9-165a99683aba tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:30.476361 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ac7da023-37d9-4bbf-91f9-165a99683aba tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:30.482956 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ac7da023-37d9-4bbf-91f9-165a99683aba tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:30.483431 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ac7da023-37d9-4bbf-91f9-165a99683aba tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:30.483854 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ac7da023-37d9-4bbf-91f9-165a99683aba tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:30.484565 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ac7da023-37d9-4bbf-91f9-165a99683aba tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:30.485034 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ac7da023-37d9-4bbf-91f9-165a99683aba tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:30.485449 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ac7da023-37d9-4bbf-91f9-165a99683aba tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:30.488165 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:47:30.619182 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ac7da023-37d9-4bbf-91f9-165a99683aba tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:30.626705 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ac7da023-37d9-4bbf-91f9-165a99683aba tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1674 microversion: 2.1 time: 0.155276 Sep 06 22:47:30.627258 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 305/602] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:47:30 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:47:31.200724 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c1785d75-e76e-41db-96c5-86cb88e35b12 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:31.201557 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c1785d75-e76e-41db-96c5-86cb88e35b12 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:31.208032 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c1785d75-e76e-41db-96c5-86cb88e35b12 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:31.208752 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c1785d75-e76e-41db-96c5-86cb88e35b12 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:31.209309 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c1785d75-e76e-41db-96c5-86cb88e35b12 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:31.210092 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c1785d75-e76e-41db-96c5-86cb88e35b12 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:31.210598 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c1785d75-e76e-41db-96c5-86cb88e35b12 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:31.211018 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c1785d75-e76e-41db-96c5-86cb88e35b12 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:31.445941 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c1785d75-e76e-41db-96c5-86cb88e35b12 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:31.453854 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c1785d75-e76e-41db-96c5-86cb88e35b12 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:31.455304 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c1785d75-e76e-41db-96c5-86cb88e35b12 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:31.456401 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c1785d75-e76e-41db-96c5-86cb88e35b12 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1407 microversion: 2.20 time: 0.260041 Sep 06 22:47:31.456982 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 298/603] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:47:31 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1407 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 22:47:31.651236 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f55cec7b-4214-4ab2-a150-e32b6b989fc8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:31.652074 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-f55cec7b-4214-4ab2-a150-e32b6b989fc8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:31.658483 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f55cec7b-4214-4ab2-a150-e32b6b989fc8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:31.658959 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f55cec7b-4214-4ab2-a150-e32b6b989fc8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:31.659383 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f55cec7b-4214-4ab2-a150-e32b6b989fc8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:31.660063 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f55cec7b-4214-4ab2-a150-e32b6b989fc8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:31.660506 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f55cec7b-4214-4ab2-a150-e32b6b989fc8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:31.660948 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f55cec7b-4214-4ab2-a150-e32b6b989fc8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:31.988003 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-f55cec7b-4214-4ab2-a150-e32b6b989fc8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:31.995957 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-f55cec7b-4214-4ab2-a150-e32b6b989fc8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1674 microversion: 2.1 time: 0.350312 Sep 06 22:47:31.996516 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 306/604] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:47:31 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1674 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:47:32.242764 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-c01ab945-d6f6-45c4-aecd-37ae6b70925b req-e391d80d-c487-48a8-a865-ca14d9c9cbed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c781a9d5-f194-47b8-870d-eab1adcc1ad5", "tag": "e9150456-138e-49eb-8d2d-f86cecea4bae"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:47:32.254977 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-c01ab945-d6f6-45c4-aecd-37ae6b70925b req-e391d80d-c487-48a8-a865-ca14d9c9cbed service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:32.256354 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-c01ab945-d6f6-45c4-aecd-37ae6b70925b req-e391d80d-c487-48a8-a865-ca14d9c9cbed service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:32.257163 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-c01ab945-d6f6-45c4-aecd-37ae6b70925b req-e391d80d-c487-48a8-a865-ca14d9c9cbed service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:32.269367 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-c01ab945-d6f6-45c4-aecd-37ae6b70925b req-e391d80d-c487-48a8-a865-ca14d9c9cbed service nova] Creating event network-changed:e9150456-138e-49eb-8d2d-f86cecea4bae for instance c781a9d5-f194-47b8-870d-eab1adcc1ad5 on hv-cinder-85220 Sep 06 22:47:32.275298 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-c01ab945-d6f6-45c4-aecd-37ae6b70925b req-e391d80d-c487-48a8-a865-ca14d9c9cbed service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042511 Sep 06 22:47:32.276108 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 299/605] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:47:32.480773 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-48fd6d4d-31fb-4069-98ce-da86326b8a7f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:32.481498 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-48fd6d4d-31fb-4069-98ce-da86326b8a7f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:32.488432 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-48fd6d4d-31fb-4069-98ce-da86326b8a7f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:32.488966 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-48fd6d4d-31fb-4069-98ce-da86326b8a7f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:32.489403 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-48fd6d4d-31fb-4069-98ce-da86326b8a7f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:32.490593 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-48fd6d4d-31fb-4069-98ce-da86326b8a7f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:32.491039 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-48fd6d4d-31fb-4069-98ce-da86326b8a7f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:32.491458 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-48fd6d4d-31fb-4069-98ce-da86326b8a7f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:32.822893 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-48fd6d4d-31fb-4069-98ce-da86326b8a7f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:32.831955 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-48fd6d4d-31fb-4069-98ce-da86326b8a7f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:32.834437 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-48fd6d4d-31fb-4069-98ce-da86326b8a7f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:32.835775 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-48fd6d4d-31fb-4069-98ce-da86326b8a7f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1407 microversion: 2.20 time: 0.359008 Sep 06 22:47:32.836589 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 307/606] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:47:32 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1407 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:47:33.020537 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1191f6e2-aa8a-4f11-b0cc-7fe2d1a74baf tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:33.021463 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1191f6e2-aa8a-4f11-b0cc-7fe2d1a74baf tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:33.027897 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1191f6e2-aa8a-4f11-b0cc-7fe2d1a74baf tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:33.028383 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1191f6e2-aa8a-4f11-b0cc-7fe2d1a74baf tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:33.028844 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1191f6e2-aa8a-4f11-b0cc-7fe2d1a74baf tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:33.029620 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1191f6e2-aa8a-4f11-b0cc-7fe2d1a74baf tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:33.029995 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1191f6e2-aa8a-4f11-b0cc-7fe2d1a74baf tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:33.030421 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1191f6e2-aa8a-4f11-b0cc-7fe2d1a74baf tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:33.051824 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:47:33.101140 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1191f6e2-aa8a-4f11-b0cc-7fe2d1a74baf tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:33.109350 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1191f6e2-aa8a-4f11-b0cc-7fe2d1a74baf tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1607 microversion: 2.1 time: 0.093256 Sep 06 22:47:33.109935 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 300/607] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:47:33 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1607 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:47:33.860098 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-7b5507f1-84a6-4a93-b10c-5b1bf4f85ef7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:33.860729 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-7b5507f1-84a6-4a93-b10c-5b1bf4f85ef7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:33.870898 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7b5507f1-84a6-4a93-b10c-5b1bf4f85ef7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:33.871389 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7b5507f1-84a6-4a93-b10c-5b1bf4f85ef7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:33.871816 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7b5507f1-84a6-4a93-b10c-5b1bf4f85ef7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:33.872532 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7b5507f1-84a6-4a93-b10c-5b1bf4f85ef7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:33.873012 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7b5507f1-84a6-4a93-b10c-5b1bf4f85ef7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:33.873428 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7b5507f1-84a6-4a93-b10c-5b1bf4f85ef7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:34.120851 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-7b5507f1-84a6-4a93-b10c-5b1bf4f85ef7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:34.129500 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-7b5507f1-84a6-4a93-b10c-5b1bf4f85ef7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:34.133649 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-81f0dfec-f080-42ec-98c9-413e57bd2017 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:34.134128 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-7b5507f1-84a6-4a93-b10c-5b1bf4f85ef7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:34.134227 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-81f0dfec-f080-42ec-98c9-413e57bd2017 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:34.135273 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-7b5507f1-84a6-4a93-b10c-5b1bf4f85ef7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1407 microversion: 2.20 time: 0.278885 Sep 06 22:47:34.136526 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 308/608] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:47:33 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1407 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:47:34.154886 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81f0dfec-f080-42ec-98c9-413e57bd2017 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:34.155510 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81f0dfec-f080-42ec-98c9-413e57bd2017 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:34.155942 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81f0dfec-f080-42ec-98c9-413e57bd2017 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:34.156637 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81f0dfec-f080-42ec-98c9-413e57bd2017 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:34.157237 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81f0dfec-f080-42ec-98c9-413e57bd2017 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:34.157684 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81f0dfec-f080-42ec-98c9-413e57bd2017 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:34.191774 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81f0dfec-f080-42ec-98c9-413e57bd2017 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:34.192252 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81f0dfec-f080-42ec-98c9-413e57bd2017 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:34.192678 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-81f0dfec-f080-42ec-98c9-413e57bd2017 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:34.193706 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-81f0dfec-f080-42ec-98c9-413e57bd2017 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lazy-loading 'fault' on Instance uuid 7bd3f7df-0b7f-451c-b6ea-c91792e466e5 {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 22:47:34.245086 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-81f0dfec-f080-42ec-98c9-413e57bd2017 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:34.252679 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-81f0dfec-f080-42ec-98c9-413e57bd2017 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 200 len: 1328 microversion: 2.1 time: 0.123562 Sep 06 22:47:34.253304 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 301/609] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:47:34 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 1328 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:47:34.293764 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-3f70e43d-22e2-4dbd-8f07-a13c6faaf20a req-0bdcd952-75a6-48fc-bfa8-603f0171c16a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bd3f7df-0b7f-451c-b6ea-c91792e466e5", "name": "network-vif-deleted", "tag": "ebeeb6bc-6ebd-470a-adfd-3cc33ae98d90"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:47:34.303289 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-3f70e43d-22e2-4dbd-8f07-a13c6faaf20a req-0bdcd952-75a6-48fc-bfa8-603f0171c16a service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:34.303764 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-3f70e43d-22e2-4dbd-8f07-a13c6faaf20a req-0bdcd952-75a6-48fc-bfa8-603f0171c16a service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:34.304185 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-3f70e43d-22e2-4dbd-8f07-a13c6faaf20a req-0bdcd952-75a6-48fc-bfa8-603f0171c16a service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:34.314778 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-3f70e43d-22e2-4dbd-8f07-a13c6faaf20a req-0bdcd952-75a6-48fc-bfa8-603f0171c16a service nova] Creating event network-vif-deleted:ebeeb6bc-6ebd-470a-adfd-3cc33ae98d90 for instance 7bd3f7df-0b7f-451c-b6ea-c91792e466e5 on hv-cinder-85220 Sep 06 22:47:34.320390 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-3f70e43d-22e2-4dbd-8f07-a13c6faaf20a req-0bdcd952-75a6-48fc-bfa8-603f0171c16a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030461 Sep 06 22:47:34.321024 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 309/610] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 22:47:35.160777 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a81e99f2-e454-42a0-b1ba-341f0e964e5f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:35.161385 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a81e99f2-e454-42a0-b1ba-341f0e964e5f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:35.167765 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a81e99f2-e454-42a0-b1ba-341f0e964e5f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:35.168249 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a81e99f2-e454-42a0-b1ba-341f0e964e5f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:35.168681 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a81e99f2-e454-42a0-b1ba-341f0e964e5f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:35.169394 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a81e99f2-e454-42a0-b1ba-341f0e964e5f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:35.169843 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a81e99f2-e454-42a0-b1ba-341f0e964e5f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:35.170263 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a81e99f2-e454-42a0-b1ba-341f0e964e5f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:35.277508 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a313cdec-0242-4f87-abe6-9884e8dfc517 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:35.278248 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-a313cdec-0242-4f87-abe6-9884e8dfc517 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:35.284178 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a313cdec-0242-4f87-abe6-9884e8dfc517 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:35.284643 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a313cdec-0242-4f87-abe6-9884e8dfc517 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:35.285101 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a313cdec-0242-4f87-abe6-9884e8dfc517 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:35.285774 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a313cdec-0242-4f87-abe6-9884e8dfc517 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:35.286213 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a313cdec-0242-4f87-abe6-9884e8dfc517 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:35.286628 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a313cdec-0242-4f87-abe6-9884e8dfc517 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:35.300034 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a81e99f2-e454-42a0-b1ba-341f0e964e5f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:35.310502 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a81e99f2-e454-42a0-b1ba-341f0e964e5f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:35.311424 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-a313cdec-0242-4f87-abe6-9884e8dfc517 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] HTTP exception thrown: Instance 7bd3f7df-0b7f-451c-b6ea-c91792e466e5 could not be found. Sep 06 22:47:35.312280 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a81e99f2-e454-42a0-b1ba-341f0e964e5f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:35.313091 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a313cdec-0242-4f87-abe6-9884e8dfc517 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Request method failure captured: Sep 06 22:47:35.313091 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: request: GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 HTTP/1.1 Sep 06 22:47:35.313091 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept: application/json Sep 06 22:47:35.313091 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Sep 06 22:47:35.313091 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Connection: close Sep 06 22:47:35.313091 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Length: 0 Sep 06 22:47:35.313091 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Type: application/json Sep 06 22:47:35.313091 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Host: 10.222.0.39 Sep 06 22:47:35.313091 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Sep 06 22:47:35.313091 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.12 Sep 06 22:47:35.313091 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABjF8zqxgSG46lj7OUxSmnOOLapQeLK_6hkI72B0BHV-jMoohA5Kb9QGJskm3XQLN61eC5nDBKhtCM_jesserHETb689YoksXKkxY5TlZimYO11KpoBkkL1idup5kLb3WBJDDGwPHr_9SXbj1IKgzToTdcJ7jlVZ1MFpP0aT-fod2Q58kQ Sep 06 22:47:35.313091 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Sep 06 22:47:35.313091 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Sep 06 22:47:35.313091 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Sep 06 22:47:35.313091 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Sep 06 22:47:35.313091 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Sep 06 22:47:35.313091 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Sep 06 22:47:35.313091 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Id: 817010ab38864d8aafb61140eb176da1 Sep 06 22:47:35.313091 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-AttachVolumeTestJSON-601810619 Sep 06 22:47:35.313091 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Role: reader,member Sep 06 22:47:35.313091 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Sep 06 22:47:35.314460 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/817010ab38864d8aafb61140eb176da1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_817010ab38864d8aafb61140eb176da1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/817010ab38864d8aafb61140eb176da1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/817010ab38864d8aafb61140eb176da1"}]}] Sep 06 22:47:35.314460 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-AttachVolumeTestJSON-601810619 Sep 06 22:47:35.314460 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 817010ab38864d8aafb61140eb176da1 Sep 06 22:47:35.314460 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-AttachVolumeTestJSON-601810619 Sep 06 22:47:35.314460 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User: tempest-AttachVolumeTestJSON-601810619-project Sep 06 22:47:35.314460 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Sep 06 22:47:35.314460 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Sep 06 22:47:35.314460 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Id: 4dd9f0bff3044d7db561dff21ac0e7ff Sep 06 22:47:35.314460 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-AttachVolumeTestJSON-601810619-project Sep 06 22:47:35.314460 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: method: > Sep 06 22:47:35.314460 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: exception: Instance 7bd3f7df-0b7f-451c-b6ea-c91792e466e5 could not be found. Sep 06 22:47:35.314460 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: action_args: {'id': '7bd3f7df-0b7f-451c-b6ea-c91792e466e5'} Sep 06 22:47:35.315306 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:47:35.315306 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:47:35.315306 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:47:35.315306 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:47:35.315306 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:47:35.315306 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:47:35.315306 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:47:35.315306 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:47:35.315306 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:47:35.315306 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:47:35.315306 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bd3f7df-0b7f-451c-b6ea-c91792e466e5 could not be found. Sep 06 22:47:35.315306 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:47:35.315306 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:47:35.315306 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:47:35.315306 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:47:35.315306 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:47:35.315306 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:47:35.315306 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:47:35.315306 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:47:35.315306 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:47:35.316556 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:47:35.316556 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 22:47:35.316556 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 22:47:35.316556 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:47:35.316556 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:47:35.316556 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:47:35.316556 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:47:35.316556 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bd3f7df-0b7f-451c-b6ea-c91792e466e5 could not be found. Sep 06 22:47:35.316556 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:47:35.316556 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:47:35.316556 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:47:35.316556 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:47:35.316556 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:47:35.316556 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:47:35.316556 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:47:35.316556 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:47:35.316556 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bd3f7df-0b7f-451c-b6ea-c91792e466e5 could not be found. Sep 06 22:47:35.316556 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:47:35.319990 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a81e99f2-e454-42a0-b1ba-341f0e964e5f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1407 microversion: 2.20 time: 0.156629 Sep 06 22:47:35.320155 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a313cdec-0242-4f87-abe6-9884e8dfc517 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Returning 404 to user: Instance 7bd3f7df-0b7f-451c-b6ea-c91792e466e5 could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:47:35.320155 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-a313cdec-0242-4f87-abe6-9884e8dfc517 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 404 len: 111 microversion: 2.1 time: 0.041951 Sep 06 22:47:35.320155 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 310/611] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:47:35 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 22:47:35.325286 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 302/612] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:47:35 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:47:35.330114 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-cb5aa879-96ff-438a-b333-4d250361dbd1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '.version_select at 0x7f9c53003700>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:35.351368 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-cb5aa879-96ff-438a-b333-4d250361dbd1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1014378103" status: 202 len: 0 microversion: 2.1 time: 0.024978 Sep 06 22:47:35.352006 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 311/613] 10.222.0.39 () {58 vars in 1221 bytes} [Tue Sep 6 22:47:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1014378103 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 22:47:36.007684 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c270984b-ca13-4c78-a1e3-e0d88f5ef4d8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Action: 'create', calling method: .version_select at 0x7f9c4f736b80>, body: {"keypair": {"name": "tempest-keypair-735381543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPw1oxqBvAiVYwzXoTRsjQluqJdt3q+JGst4WUgLvNUZ0FUg7G1j9AXbqhsPvXYEyumnzhAlHOqp8ycI0bfKxyFwAhCret71U2y1APlTw8ISdRnEbSZdD+0G2fP4kqbs2Q=="}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:47:36.023163 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-c270984b-ca13-4c78-a1e3-e0d88f5ef4d8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Getting quotas for project 817010ab38864d8aafb61140eb176da1. Resources: {'key_pairs'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 22:47:36.027158 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-c270984b-ca13-4c78-a1e3-e0d88f5ef4d8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Getting quotas for user 4dd9f0bff3044d7db561dff21ac0e7ff and project 817010ab38864d8aafb61140eb176da1. Resources: {'key_pairs'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 22:47:36.048435 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c270984b-ca13-4c78-a1e3-e0d88f5ef4d8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045330 Sep 06 22:47:36.049061 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 303/614] 10.222.0.39 () {60 vars in 1159 bytes} [Tue Sep 6 22:47:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:47:36.340467 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-2385cae7-1515-46f3-83d7-9679ed6d1101 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:36.341684 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-2385cae7-1515-46f3-83d7-9679ed6d1101 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:36.348256 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2385cae7-1515-46f3-83d7-9679ed6d1101 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:36.348727 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2385cae7-1515-46f3-83d7-9679ed6d1101 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:36.349727 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2385cae7-1515-46f3-83d7-9679ed6d1101 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:36.350598 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2385cae7-1515-46f3-83d7-9679ed6d1101 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:36.351016 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2385cae7-1515-46f3-83d7-9679ed6d1101 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:36.351423 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2385cae7-1515-46f3-83d7-9679ed6d1101 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:36.525656 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-2385cae7-1515-46f3-83d7-9679ed6d1101 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:36.535441 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-2385cae7-1515-46f3-83d7-9679ed6d1101 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:36.537738 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-2385cae7-1515-46f3-83d7-9679ed6d1101 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:36.538832 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-2385cae7-1515-46f3-83d7-9679ed6d1101 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1407 microversion: 2.20 time: 0.203094 Sep 06 22:47:36.539378 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 312/615] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:47:36 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:47:37.470853 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-2323ffd2-8fb6-4d6a-b2bf-ebcb7d8d7285 req-e5c3937a-1cd5-4b48-919c-d3f875d77d61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c781a9d5-f194-47b8-870d-eab1adcc1ad5", "name": "network-vif-plugged", "status": "completed", "tag": "e9150456-138e-49eb-8d2d-f86cecea4bae"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:47:37.488414 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-2323ffd2-8fb6-4d6a-b2bf-ebcb7d8d7285 req-e5c3937a-1cd5-4b48-919c-d3f875d77d61 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:37.489040 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-2323ffd2-8fb6-4d6a-b2bf-ebcb7d8d7285 req-e5c3937a-1cd5-4b48-919c-d3f875d77d61 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:37.489715 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-2323ffd2-8fb6-4d6a-b2bf-ebcb7d8d7285 req-e5c3937a-1cd5-4b48-919c-d3f875d77d61 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:37.500843 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-2323ffd2-8fb6-4d6a-b2bf-ebcb7d8d7285 req-e5c3937a-1cd5-4b48-919c-d3f875d77d61 service nova] Creating event network-vif-plugged:e9150456-138e-49eb-8d2d-f86cecea4bae for instance c781a9d5-f194-47b8-870d-eab1adcc1ad5 on hv-cinder-85220 Sep 06 22:47:37.506800 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-2323ffd2-8fb6-4d6a-b2bf-ebcb7d8d7285 req-e5c3937a-1cd5-4b48-919c-d3f875d77d61 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039928 Sep 06 22:47:37.507312 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 304/616] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:47:37.564578 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-78124a6d-ba1d-42af-a136-b9fa1d178d00 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:37.565172 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-78124a6d-ba1d-42af-a136-b9fa1d178d00 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:37.572350 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-78124a6d-ba1d-42af-a136-b9fa1d178d00 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:37.573160 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-78124a6d-ba1d-42af-a136-b9fa1d178d00 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:37.573907 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-78124a6d-ba1d-42af-a136-b9fa1d178d00 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:37.581888 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-78124a6d-ba1d-42af-a136-b9fa1d178d00 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:37.582509 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-78124a6d-ba1d-42af-a136-b9fa1d178d00 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:37.583120 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-78124a6d-ba1d-42af-a136-b9fa1d178d00 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:37.587753 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9eade2cf-d1d4-4ac7-a700-4061fce9e37c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-194290815", "imageRef": "93326d5e-4826-431e-9ad1-6ee2d44e48d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dca78c2a-dc31-4fa0-b0e0-5bcdd9a87416"}], "security_groups": [{"name": "tempest-securitygroup--847921599"}], "key_name": "tempest-keypair-735381543", "user_data": "}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:47:37.707216 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:47:37.769261 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.network.neutron [None req-9eade2cf-d1d4-4ac7-a700-4061fce9e37c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] validate_networks() for [('dca78c2a-dc31-4fa0-b0e0-5bcdd9a87416', None, None, None, None, None)] {{(pid=127088) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 22:47:37.861907 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=6 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:47:37.869636 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-78124a6d-ba1d-42af-a136-b9fa1d178d00 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:37.877794 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-78124a6d-ba1d-42af-a136-b9fa1d178d00 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:37.879233 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-78124a6d-ba1d-42af-a136-b9fa1d178d00 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:37.880391 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-78124a6d-ba1d-42af-a136-b9fa1d178d00 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1407 microversion: 2.20 time: 0.319664 Sep 06 22:47:37.881342 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 313/617] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:47:37 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1407 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:47:38.195155 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-9eade2cf-d1d4-4ac7-a700-4061fce9e37c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Flavor limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 22:47:38.195576 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-9eade2cf-d1d4-4ac7-a700-4061fce9e37c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Image limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 22:47:38.196041 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-9eade2cf-d1d4-4ac7-a700-4061fce9e37c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Flavor pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 22:47:38.196442 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-9eade2cf-d1d4-4ac7-a700-4061fce9e37c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Image pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 22:47:38.196912 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-9eade2cf-d1d4-4ac7-a700-4061fce9e37c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 22:47:38.205642 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9eade2cf-d1d4-4ac7-a700-4061fce9e37c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:38.206117 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9eade2cf-d1d4-4ac7-a700-4061fce9e37c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:38.206548 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9eade2cf-d1d4-4ac7-a700-4061fce9e37c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:38.207269 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9eade2cf-d1d4-4ac7-a700-4061fce9e37c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:38.207716 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9eade2cf-d1d4-4ac7-a700-4061fce9e37c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:38.208133 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9eade2cf-d1d4-4ac7-a700-4061fce9e37c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:38.225896 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-9eade2cf-d1d4-4ac7-a700-4061fce9e37c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Getting quotas for project 817010ab38864d8aafb61140eb176da1. Resources: {'instances', 'ram', 'cores'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 22:47:38.229811 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-9eade2cf-d1d4-4ac7-a700-4061fce9e37c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Getting quotas for user 4dd9f0bff3044d7db561dff21ac0e7ff and project 817010ab38864d8aafb61140eb176da1. Resources: {'instances', 'ram', 'cores'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 22:47:38.241513 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9eade2cf-d1d4-4ac7-a700-4061fce9e37c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Going to run 1 instances... {{(pid=127088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 22:47:38.243846 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9eade2cf-d1d4-4ac7-a700-4061fce9e37c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 629fd4f8-24b5-4287-bfe2-ba789169bdb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='93326d5e-4826-431e-9ad1-6ee2d44e48d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 22:47:38.292477 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9eade2cf-d1d4-4ac7-a700-4061fce9e37c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.711153 Sep 06 22:47:38.293154 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 305/618] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Sep 6 22:47:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 22:47:38.304272 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-c7aafa0f-bb3d-49ef-8736-510a0dbde83c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:38.304909 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-c7aafa0f-bb3d-49ef-8736-510a0dbde83c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 629fd4f8-24b5-4287-bfe2-ba789169bdb3] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:38.364229 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-c7aafa0f-bb3d-49ef-8736-510a0dbde83c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:38.371363 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-c7aafa0f-bb3d-49ef-8736-510a0dbde83c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3" status: 200 len: 1236 microversion: 2.1 time: 0.071020 Sep 06 22:47:38.371953 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 314/619] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:47:38 2022] GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3 => generated 1236 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:47:38.906565 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7d21cd67-eb02-4e61-81bc-e44626aca116 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:38.907108 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7d21cd67-eb02-4e61-81bc-e44626aca116 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:38.915946 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d21cd67-eb02-4e61-81bc-e44626aca116 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:38.916425 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d21cd67-eb02-4e61-81bc-e44626aca116 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:38.916990 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d21cd67-eb02-4e61-81bc-e44626aca116 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:38.917683 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d21cd67-eb02-4e61-81bc-e44626aca116 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:38.918163 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d21cd67-eb02-4e61-81bc-e44626aca116 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:38.918582 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d21cd67-eb02-4e61-81bc-e44626aca116 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:39.049612 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7d21cd67-eb02-4e61-81bc-e44626aca116 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:39.058266 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7d21cd67-eb02-4e61-81bc-e44626aca116 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:39.059713 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7d21cd67-eb02-4e61-81bc-e44626aca116 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:39.061168 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7d21cd67-eb02-4e61-81bc-e44626aca116 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1407 microversion: 2.20 time: 0.158855 Sep 06 22:47:39.061749 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 306/620] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:47:38 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:47:39.393702 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b66c5fb2-73ab-4334-9f5c-1dabc767a6e1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:39.394308 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b66c5fb2-73ab-4334-9f5c-1dabc767a6e1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 629fd4f8-24b5-4287-bfe2-ba789169bdb3] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:39.401969 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b66c5fb2-73ab-4334-9f5c-1dabc767a6e1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:39.402444 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b66c5fb2-73ab-4334-9f5c-1dabc767a6e1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:39.402876 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b66c5fb2-73ab-4334-9f5c-1dabc767a6e1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:39.403554 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b66c5fb2-73ab-4334-9f5c-1dabc767a6e1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:39.403996 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b66c5fb2-73ab-4334-9f5c-1dabc767a6e1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:39.404409 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b66c5fb2-73ab-4334-9f5c-1dabc767a6e1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:39.645933 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b66c5fb2-73ab-4334-9f5c-1dabc767a6e1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:39.655475 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b66c5fb2-73ab-4334-9f5c-1dabc767a6e1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3" status: 200 len: 1288 microversion: 2.1 time: 0.265762 Sep 06 22:47:39.656024 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 315/621] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:47:39 2022] GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3 => generated 1288 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:47:40.087192 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-621e88bd-df97-4b0e-9854-d0902bc720e3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:40.087791 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-621e88bd-df97-4b0e-9854-d0902bc720e3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:40.093968 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-621e88bd-df97-4b0e-9854-d0902bc720e3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:40.094448 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-621e88bd-df97-4b0e-9854-d0902bc720e3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:40.095066 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-621e88bd-df97-4b0e-9854-d0902bc720e3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:40.095956 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-621e88bd-df97-4b0e-9854-d0902bc720e3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:40.096411 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-621e88bd-df97-4b0e-9854-d0902bc720e3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:40.096859 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-621e88bd-df97-4b0e-9854-d0902bc720e3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:40.312678 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-621e88bd-df97-4b0e-9854-d0902bc720e3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:40.322081 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-621e88bd-df97-4b0e-9854-d0902bc720e3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:40.323542 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-621e88bd-df97-4b0e-9854-d0902bc720e3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:40.324688 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-621e88bd-df97-4b0e-9854-d0902bc720e3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1599 microversion: 2.20 time: 0.241647 Sep 06 22:47:40.325283 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 307/622] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:47:40 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1599 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:47:40.350118 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6d0682eb-95b7-4cbd-804e-4ca2648ff9be tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:40.350609 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-6d0682eb-95b7-4cbd-804e-4ca2648ff9be tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:40.356706 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6d0682eb-95b7-4cbd-804e-4ca2648ff9be tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:40.357220 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6d0682eb-95b7-4cbd-804e-4ca2648ff9be tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:40.357653 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6d0682eb-95b7-4cbd-804e-4ca2648ff9be tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:40.358343 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6d0682eb-95b7-4cbd-804e-4ca2648ff9be tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:40.358789 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6d0682eb-95b7-4cbd-804e-4ca2648ff9be tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:40.359209 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6d0682eb-95b7-4cbd-804e-4ca2648ff9be tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:40.477111 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-6d0682eb-95b7-4cbd-804e-4ca2648ff9be tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.130980 Sep 06 22:47:40.477706 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 316/623] 10.222.0.39 () {60 vars in 1316 bytes} [Tue Sep 6 22:47:40 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5/os-interface => generated 284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 22:47:40.679730 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d40abde5-13a5-4094-b89f-3d3f98734905 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:40.680637 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d40abde5-13a5-4094-b89f-3d3f98734905 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 629fd4f8-24b5-4287-bfe2-ba789169bdb3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:40.686853 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d40abde5-13a5-4094-b89f-3d3f98734905 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:40.687454 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d40abde5-13a5-4094-b89f-3d3f98734905 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:40.688156 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d40abde5-13a5-4094-b89f-3d3f98734905 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:40.688980 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d40abde5-13a5-4094-b89f-3d3f98734905 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:40.689477 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d40abde5-13a5-4094-b89f-3d3f98734905 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:40.689959 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d40abde5-13a5-4094-b89f-3d3f98734905 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:40.918733 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d40abde5-13a5-4094-b89f-3d3f98734905 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:40.930330 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d40abde5-13a5-4094-b89f-3d3f98734905 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3" status: 200 len: 1361 microversion: 2.1 time: 0.254597 Sep 06 22:47:40.932162 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 308/624] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:47:40 2022] GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3 => generated 1361 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:47:41.475825 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-b2a9d38b-9099-4543-8f05-62dd1b509a0e req-11a2226d-1e75-45db-9e23-efb302a42a6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c781a9d5-f194-47b8-870d-eab1adcc1ad5", "tag": "e9150456-138e-49eb-8d2d-f86cecea4bae"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:47:41.486458 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-b2a9d38b-9099-4543-8f05-62dd1b509a0e req-11a2226d-1e75-45db-9e23-efb302a42a6d service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:41.487537 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-b2a9d38b-9099-4543-8f05-62dd1b509a0e req-11a2226d-1e75-45db-9e23-efb302a42a6d service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:41.488146 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-b2a9d38b-9099-4543-8f05-62dd1b509a0e req-11a2226d-1e75-45db-9e23-efb302a42a6d service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:41.500132 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-b2a9d38b-9099-4543-8f05-62dd1b509a0e req-11a2226d-1e75-45db-9e23-efb302a42a6d service nova] Creating event network-changed:e9150456-138e-49eb-8d2d-f86cecea4bae for instance c781a9d5-f194-47b8-870d-eab1adcc1ad5 on hv-cinder-85220 Sep 06 22:47:41.506030 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-b2a9d38b-9099-4543-8f05-62dd1b509a0e req-11a2226d-1e75-45db-9e23-efb302a42a6d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033100 Sep 06 22:47:41.507150 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 317/625] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:47:41.716206 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-343575a3-8e5f-40c8-a1c6-89ad3283b582 req-00efe24d-45a6-41a6-a11a-0f2f43cef395 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "629fd4f8-24b5-4287-bfe2-ba789169bdb3", "tag": "f495fe0d-6277-4e7f-8ade-646a2dd3193c"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:47:41.731648 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-343575a3-8e5f-40c8-a1c6-89ad3283b582 req-00efe24d-45a6-41a6-a11a-0f2f43cef395 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:41.732238 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-343575a3-8e5f-40c8-a1c6-89ad3283b582 req-00efe24d-45a6-41a6-a11a-0f2f43cef395 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:41.732950 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-343575a3-8e5f-40c8-a1c6-89ad3283b582 req-00efe24d-45a6-41a6-a11a-0f2f43cef395 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:41.746683 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-343575a3-8e5f-40c8-a1c6-89ad3283b582 req-00efe24d-45a6-41a6-a11a-0f2f43cef395 service nova] Creating event network-changed:f495fe0d-6277-4e7f-8ade-646a2dd3193c for instance 629fd4f8-24b5-4287-bfe2-ba789169bdb3 on hv-cinder-85220 Sep 06 22:47:41.753937 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-343575a3-8e5f-40c8-a1c6-89ad3283b582 req-00efe24d-45a6-41a6-a11a-0f2f43cef395 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042194 Sep 06 22:47:41.754904 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 309/626] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:47:41.956213 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-59913e08-8709-417e-b4d0-8d64b8a5598e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:41.957679 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-59913e08-8709-417e-b4d0-8d64b8a5598e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 629fd4f8-24b5-4287-bfe2-ba789169bdb3] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:41.964716 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-59913e08-8709-417e-b4d0-8d64b8a5598e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:41.965231 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-59913e08-8709-417e-b4d0-8d64b8a5598e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:41.965661 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-59913e08-8709-417e-b4d0-8d64b8a5598e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:41.966354 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-59913e08-8709-417e-b4d0-8d64b8a5598e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:41.966798 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-59913e08-8709-417e-b4d0-8d64b8a5598e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:41.967242 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-59913e08-8709-417e-b4d0-8d64b8a5598e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:42.277304 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-59913e08-8709-417e-b4d0-8d64b8a5598e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:42.285564 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-59913e08-8709-417e-b4d0-8d64b8a5598e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3" status: 200 len: 1361 microversion: 2.1 time: 0.333868 Sep 06 22:47:42.294423 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 318/627] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:47:41 2022] GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3 => generated 1361 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:47:43.311744 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-affdf8ed-3421-41a8-987a-01593d3a8d0f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:43.312524 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-affdf8ed-3421-41a8-987a-01593d3a8d0f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 629fd4f8-24b5-4287-bfe2-ba789169bdb3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:43.315197 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:47:43.322135 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-affdf8ed-3421-41a8-987a-01593d3a8d0f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:43.322616 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-affdf8ed-3421-41a8-987a-01593d3a8d0f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:43.323076 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-affdf8ed-3421-41a8-987a-01593d3a8d0f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:43.323774 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-affdf8ed-3421-41a8-987a-01593d3a8d0f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:43.324221 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-affdf8ed-3421-41a8-987a-01593d3a8d0f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:43.324635 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-affdf8ed-3421-41a8-987a-01593d3a8d0f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:43.592049 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-affdf8ed-3421-41a8-987a-01593d3a8d0f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:43.600737 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-affdf8ed-3421-41a8-987a-01593d3a8d0f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3" status: 200 len: 1361 microversion: 2.1 time: 0.295031 Sep 06 22:47:43.601524 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 310/628] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:47:43 2022] GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3 => generated 1361 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:47:44.623184 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-5b9ac56b-e69b-4e2c-947d-2904a8a681e3 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:44.623787 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-5b9ac56b-e69b-4e2c-947d-2904a8a681e3 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 629fd4f8-24b5-4287-bfe2-ba789169bdb3] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:44.630285 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5b9ac56b-e69b-4e2c-947d-2904a8a681e3 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:44.630802 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5b9ac56b-e69b-4e2c-947d-2904a8a681e3 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:44.631326 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5b9ac56b-e69b-4e2c-947d-2904a8a681e3 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:44.632012 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5b9ac56b-e69b-4e2c-947d-2904a8a681e3 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:44.632455 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5b9ac56b-e69b-4e2c-947d-2904a8a681e3 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:44.632900 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5b9ac56b-e69b-4e2c-947d-2904a8a681e3 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:44.760021 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-5b9ac56b-e69b-4e2c-947d-2904a8a681e3 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:44.767579 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-5b9ac56b-e69b-4e2c-947d-2904a8a681e3 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3" status: 200 len: 1361 microversion: 2.1 time: 0.148271 Sep 06 22:47:44.768132 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 319/629] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:47:44 2022] GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3 => generated 1361 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:47:45.791080 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-23c46ea0-7fc5-4a63-8706-9ba59c1c0bf8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:45.791678 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-23c46ea0-7fc5-4a63-8706-9ba59c1c0bf8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 629fd4f8-24b5-4287-bfe2-ba789169bdb3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:45.798065 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-23c46ea0-7fc5-4a63-8706-9ba59c1c0bf8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:45.798540 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-23c46ea0-7fc5-4a63-8706-9ba59c1c0bf8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:45.798963 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-23c46ea0-7fc5-4a63-8706-9ba59c1c0bf8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:45.799636 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-23c46ea0-7fc5-4a63-8706-9ba59c1c0bf8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:45.800087 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-23c46ea0-7fc5-4a63-8706-9ba59c1c0bf8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:45.800487 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-23c46ea0-7fc5-4a63-8706-9ba59c1c0bf8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:45.938577 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-23c46ea0-7fc5-4a63-8706-9ba59c1c0bf8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:45.946366 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-23c46ea0-7fc5-4a63-8706-9ba59c1c0bf8 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3" status: 200 len: 1361 microversion: 2.1 time: 0.159850 Sep 06 22:47:45.946930 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 311/630] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:47:45 2022] GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:47:46.969322 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-68541db1-3fd1-4811-801f-20261ae94861 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:46.969960 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-68541db1-3fd1-4811-801f-20261ae94861 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 629fd4f8-24b5-4287-bfe2-ba789169bdb3] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:46.977408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-68541db1-3fd1-4811-801f-20261ae94861 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:46.977886 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-68541db1-3fd1-4811-801f-20261ae94861 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:46.978322 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-68541db1-3fd1-4811-801f-20261ae94861 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:46.979016 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-68541db1-3fd1-4811-801f-20261ae94861 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:46.979460 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-68541db1-3fd1-4811-801f-20261ae94861 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:46.979883 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-68541db1-3fd1-4811-801f-20261ae94861 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:47.110252 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-68541db1-3fd1-4811-801f-20261ae94861 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:47.118630 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-68541db1-3fd1-4811-801f-20261ae94861 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3" status: 200 len: 1361 microversion: 2.1 time: 0.153107 Sep 06 22:47:47.119185 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 320/631] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:47:46 2022] GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:47:47.485622 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-f50e5573-3592-4fb7-a18f-259c4ba683f8 req-4756e789-aad3-4f58-aea9-3eab81952cc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "629fd4f8-24b5-4287-bfe2-ba789169bdb3", "name": "network-vif-plugged", "status": "completed", "tag": "f495fe0d-6277-4e7f-8ade-646a2dd3193c"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:47:47.498037 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-f50e5573-3592-4fb7-a18f-259c4ba683f8 req-4756e789-aad3-4f58-aea9-3eab81952cc9 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:47.499015 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-f50e5573-3592-4fb7-a18f-259c4ba683f8 req-4756e789-aad3-4f58-aea9-3eab81952cc9 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:47.499490 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-f50e5573-3592-4fb7-a18f-259c4ba683f8 req-4756e789-aad3-4f58-aea9-3eab81952cc9 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:47.514366 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-f50e5573-3592-4fb7-a18f-259c4ba683f8 req-4756e789-aad3-4f58-aea9-3eab81952cc9 service nova] Creating event network-vif-plugged:f495fe0d-6277-4e7f-8ade-646a2dd3193c for instance 629fd4f8-24b5-4287-bfe2-ba789169bdb3 on hv-cinder-85220 Sep 06 22:47:47.519370 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-f50e5573-3592-4fb7-a18f-259c4ba683f8 req-4756e789-aad3-4f58-aea9-3eab81952cc9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037844 Sep 06 22:47:47.520364 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 312/632] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:47:48.141355 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-98b228df-147c-4bc5-930e-2f012ab97d11 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:48.141965 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-98b228df-147c-4bc5-930e-2f012ab97d11 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 629fd4f8-24b5-4287-bfe2-ba789169bdb3] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:48.148930 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-98b228df-147c-4bc5-930e-2f012ab97d11 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:48.149664 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-98b228df-147c-4bc5-930e-2f012ab97d11 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:48.150092 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-98b228df-147c-4bc5-930e-2f012ab97d11 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:48.150775 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-98b228df-147c-4bc5-930e-2f012ab97d11 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:48.151222 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-98b228df-147c-4bc5-930e-2f012ab97d11 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:48.151638 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-98b228df-147c-4bc5-930e-2f012ab97d11 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:48.368666 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=2 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:47:48.540896 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-98b228df-147c-4bc5-930e-2f012ab97d11 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:48.548364 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-98b228df-147c-4bc5-930e-2f012ab97d11 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3" status: 200 len: 1361 microversion: 2.1 time: 0.410893 Sep 06 22:47:48.548951 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 321/633] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:47:48 2022] GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3 => generated 1361 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:47:49.568055 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:47:49.568841 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=16 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:47:49.573850 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6fcd8af3-cbbc-4e7b-8898-baf061a50ca3 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:49.574582 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6fcd8af3-cbbc-4e7b-8898-baf061a50ca3 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 629fd4f8-24b5-4287-bfe2-ba789169bdb3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:49.581735 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6fcd8af3-cbbc-4e7b-8898-baf061a50ca3 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:49.582223 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6fcd8af3-cbbc-4e7b-8898-baf061a50ca3 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:49.582655 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6fcd8af3-cbbc-4e7b-8898-baf061a50ca3 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:49.583839 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6fcd8af3-cbbc-4e7b-8898-baf061a50ca3 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:49.584287 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6fcd8af3-cbbc-4e7b-8898-baf061a50ca3 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:49.584711 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6fcd8af3-cbbc-4e7b-8898-baf061a50ca3 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:49.718025 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6fcd8af3-cbbc-4e7b-8898-baf061a50ca3 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:49.726486 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6fcd8af3-cbbc-4e7b-8898-baf061a50ca3 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3" status: 200 len: 1546 microversion: 2.1 time: 0.159496 Sep 06 22:47:49.727059 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 313/634] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:47:49 2022] GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3 => generated 1546 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:47:49.748875 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e4c1561b-a623-4839-b1fb-d212093f1d06 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:49.749380 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e4c1561b-a623-4839-b1fb-d212093f1d06 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 629fd4f8-24b5-4287-bfe2-ba789169bdb3] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:49.751675 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:47:49.756716 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e4c1561b-a623-4839-b1fb-d212093f1d06 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:49.757226 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e4c1561b-a623-4839-b1fb-d212093f1d06 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:49.757652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e4c1561b-a623-4839-b1fb-d212093f1d06 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:49.758328 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e4c1561b-a623-4839-b1fb-d212093f1d06 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:49.758769 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e4c1561b-a623-4839-b1fb-d212093f1d06 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:49.759180 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e4c1561b-a623-4839-b1fb-d212093f1d06 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:49.839595 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e4c1561b-a623-4839-b1fb-d212093f1d06 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094582 Sep 06 22:47:49.840208 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 322/635] 10.222.0.39 () {58 vars in 1275 bytes} [Tue Sep 6 22:47:49 2022] GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:47:50.752659 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-5f87cb29-92fa-40da-ace8-3338edcbc53a req-ce1b4366-6ee7-45be-bf63-15f9e9e6d1fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "629fd4f8-24b5-4287-bfe2-ba789169bdb3", "tag": "f495fe0d-6277-4e7f-8ade-646a2dd3193c"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:47:50.762583 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-5f87cb29-92fa-40da-ace8-3338edcbc53a req-ce1b4366-6ee7-45be-bf63-15f9e9e6d1fd service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:50.763060 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-5f87cb29-92fa-40da-ace8-3338edcbc53a req-ce1b4366-6ee7-45be-bf63-15f9e9e6d1fd service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:50.763824 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-5f87cb29-92fa-40da-ace8-3338edcbc53a req-ce1b4366-6ee7-45be-bf63-15f9e9e6d1fd service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:50.775303 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-5f87cb29-92fa-40da-ace8-3338edcbc53a req-ce1b4366-6ee7-45be-bf63-15f9e9e6d1fd service nova] Creating event network-changed:f495fe0d-6277-4e7f-8ade-646a2dd3193c for instance 629fd4f8-24b5-4287-bfe2-ba789169bdb3 on hv-cinder-85220 Sep 06 22:47:50.780210 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-5f87cb29-92fa-40da-ace8-3338edcbc53a req-ce1b4366-6ee7-45be-bf63-15f9e9e6d1fd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031216 Sep 06 22:47:50.780912 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 314/636] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:47:53.001780 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-2366d170-8c9c-4c79-a8de-83112c39be67 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:53.002366 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-2366d170-8c9c-4c79-a8de-83112c39be67 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:53.008640 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2366d170-8c9c-4c79-a8de-83112c39be67 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:53.009158 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2366d170-8c9c-4c79-a8de-83112c39be67 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:53.009589 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2366d170-8c9c-4c79-a8de-83112c39be67 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:53.010283 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2366d170-8c9c-4c79-a8de-83112c39be67 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:53.010732 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2366d170-8c9c-4c79-a8de-83112c39be67 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:53.011147 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2366d170-8c9c-4c79-a8de-83112c39be67 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:53.094043 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.objects.instance [None req-2366d170-8c9c-4c79-a8de-83112c39be67 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lazy-loading 'services' on Instance uuid 7b07b208-45e2-45aa-ad7b-bede527cfb6d {{(pid=127087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 22:47:53.169080 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-2366d170-8c9c-4c79-a8de-83112c39be67 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d/os-volume_attachments/77ebcfbd-9b8e-419d-abfd-9e6537190a8c" status: 202 len: 0 microversion: 2.1 time: 0.171887 Sep 06 22:47:53.169687 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 323/637] 10.222.0.39 () {58 vars in 1416 bytes} [Tue Sep 6 22:47:52 2022] DELETE /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d/os-volume_attachments/77ebcfbd-9b8e-419d-abfd-9e6537190a8c => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 22:47:53.182499 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-88bbb1ed-c92c-414a-9fbd-97a3ac1d5739 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:53.184731 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-88bbb1ed-c92c-414a-9fbd-97a3ac1d5739 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:53.191548 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88bbb1ed-c92c-414a-9fbd-97a3ac1d5739 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:53.192255 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88bbb1ed-c92c-414a-9fbd-97a3ac1d5739 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:53.193023 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88bbb1ed-c92c-414a-9fbd-97a3ac1d5739 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:53.193872 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88bbb1ed-c92c-414a-9fbd-97a3ac1d5739 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:53.194409 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88bbb1ed-c92c-414a-9fbd-97a3ac1d5739 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:53.194872 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-88bbb1ed-c92c-414a-9fbd-97a3ac1d5739 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:53.229595 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-88bbb1ed-c92c-414a-9fbd-97a3ac1d5739 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052632 Sep 06 22:47:53.230262 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 315/638] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Sep 6 22:47:53 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 22:47:54.244066 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9c0f816a-7158-44de-83c9-e86114205121 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:54.246326 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9c0f816a-7158-44de-83c9-e86114205121 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:54.252449 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9c0f816a-7158-44de-83c9-e86114205121 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:54.252976 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9c0f816a-7158-44de-83c9-e86114205121 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:54.253406 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9c0f816a-7158-44de-83c9-e86114205121 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:54.254083 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9c0f816a-7158-44de-83c9-e86114205121 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:54.254525 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9c0f816a-7158-44de-83c9-e86114205121 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:54.254937 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9c0f816a-7158-44de-83c9-e86114205121 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:54.285338 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9c0f816a-7158-44de-83c9-e86114205121 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046988 Sep 06 22:47:54.285885 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 324/639] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Sep 6 22:47:54 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 22:47:54.370117 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f73f8ff2-6a47-495d-a792-8f2f55191640 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:54.370661 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f73f8ff2-6a47-495d-a792-8f2f55191640 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:54.376705 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f73f8ff2-6a47-495d-a792-8f2f55191640 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:54.377214 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f73f8ff2-6a47-495d-a792-8f2f55191640 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:54.377646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f73f8ff2-6a47-495d-a792-8f2f55191640 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:54.378330 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f73f8ff2-6a47-495d-a792-8f2f55191640 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:54.378775 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f73f8ff2-6a47-495d-a792-8f2f55191640 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:54.379193 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f73f8ff2-6a47-495d-a792-8f2f55191640 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:54.404943 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f73f8ff2-6a47-495d-a792-8f2f55191640 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Going to try to terminate instance {{(pid=127088) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 22:47:54.480110 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f73f8ff2-6a47-495d-a792-8f2f55191640 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 204 len: 0 microversion: 2.1 time: 0.114307 Sep 06 22:47:54.480816 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 316/640] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Sep 6 22:47:54 2022] DELETE /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 22:47:54.488516 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-90c5d570-7c97-4b8b-be9b-9252f37a65a8 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:54.489138 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-90c5d570-7c97-4b8b-be9b-9252f37a65a8 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:54.495046 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-90c5d570-7c97-4b8b-be9b-9252f37a65a8 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:54.495454 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-90c5d570-7c97-4b8b-be9b-9252f37a65a8 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:54.495877 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-90c5d570-7c97-4b8b-be9b-9252f37a65a8 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:54.496547 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-90c5d570-7c97-4b8b-be9b-9252f37a65a8 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:54.497014 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-90c5d570-7c97-4b8b-be9b-9252f37a65a8 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:54.497423 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-90c5d570-7c97-4b8b-be9b-9252f37a65a8 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:54.625532 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-90c5d570-7c97-4b8b-be9b-9252f37a65a8 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:54.627765 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:47:54.635384 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-90c5d570-7c97-4b8b-be9b-9252f37a65a8 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1691 microversion: 2.1 time: 0.150668 Sep 06 22:47:54.635953 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 325/641] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:47:54 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:47:55.659149 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a1d10b00-3677-419b-bc3d-13e599c576b9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:55.659875 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a1d10b00-3677-419b-bc3d-13e599c576b9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:55.666336 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a1d10b00-3677-419b-bc3d-13e599c576b9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:55.666813 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a1d10b00-3677-419b-bc3d-13e599c576b9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:55.667243 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a1d10b00-3677-419b-bc3d-13e599c576b9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:55.667927 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a1d10b00-3677-419b-bc3d-13e599c576b9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:55.668377 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a1d10b00-3677-419b-bc3d-13e599c576b9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:55.668817 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a1d10b00-3677-419b-bc3d-13e599c576b9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:55.812142 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a1d10b00-3677-419b-bc3d-13e599c576b9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:55.820555 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a1d10b00-3677-419b-bc3d-13e599c576b9 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1691 microversion: 2.1 time: 0.165627 Sep 06 22:47:55.821133 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 317/642] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:47:55 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1691 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:47:56.843781 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-fbfe161b-53e1-4429-b32e-d29fdb668651 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:56.844418 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-fbfe161b-53e1-4429-b32e-d29fdb668651 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:56.851554 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fbfe161b-53e1-4429-b32e-d29fdb668651 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:56.852041 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fbfe161b-53e1-4429-b32e-d29fdb668651 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:56.852479 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fbfe161b-53e1-4429-b32e-d29fdb668651 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:56.853205 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fbfe161b-53e1-4429-b32e-d29fdb668651 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:56.853656 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fbfe161b-53e1-4429-b32e-d29fdb668651 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:56.854076 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fbfe161b-53e1-4429-b32e-d29fdb668651 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:56.994331 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-fbfe161b-53e1-4429-b32e-d29fdb668651 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:57.002008 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-fbfe161b-53e1-4429-b32e-d29fdb668651 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1691 microversion: 2.1 time: 0.162486 Sep 06 22:47:57.002565 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 326/643] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:47:56 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:47:58.024854 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3c592374-64a3-4cf1-b17f-f21447f5ca47 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:58.025439 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3c592374-64a3-4cf1-b17f-f21447f5ca47 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:58.031761 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3c592374-64a3-4cf1-b17f-f21447f5ca47 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:58.032235 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3c592374-64a3-4cf1-b17f-f21447f5ca47 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:58.032658 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3c592374-64a3-4cf1-b17f-f21447f5ca47 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:58.033374 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3c592374-64a3-4cf1-b17f-f21447f5ca47 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:58.033817 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3c592374-64a3-4cf1-b17f-f21447f5ca47 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:58.034232 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3c592374-64a3-4cf1-b17f-f21447f5ca47 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:58.271838 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-3c592374-64a3-4cf1-b17f-f21447f5ca47 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:58.279811 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3c592374-64a3-4cf1-b17f-f21447f5ca47 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1691 microversion: 2.1 time: 0.259385 Sep 06 22:47:58.280614 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 318/644] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:47:58 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1691 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:47:58.914469 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-ed19d54f-628c-41dc-9e5f-39ffc93451a2 req-b4935854-8b88-4104-aabb-497eb487da61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b07b208-45e2-45aa-ad7b-bede527cfb6d", "name": "network-vif-deleted", "tag": "bc5d6b1f-b033-4efc-ac9f-ff0f920a565c"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:47:58.924396 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-ed19d54f-628c-41dc-9e5f-39ffc93451a2 req-b4935854-8b88-4104-aabb-497eb487da61 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:58.924902 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-ed19d54f-628c-41dc-9e5f-39ffc93451a2 req-b4935854-8b88-4104-aabb-497eb487da61 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:58.925333 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-ed19d54f-628c-41dc-9e5f-39ffc93451a2 req-b4935854-8b88-4104-aabb-497eb487da61 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:58.937613 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-ed19d54f-628c-41dc-9e5f-39ffc93451a2 req-b4935854-8b88-4104-aabb-497eb487da61 service nova] Creating event network-vif-deleted:bc5d6b1f-b033-4efc-ac9f-ff0f920a565c for instance 7b07b208-45e2-45aa-ad7b-bede527cfb6d on hv-cinder-85220 Sep 06 22:47:58.942986 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-ed19d54f-628c-41dc-9e5f-39ffc93451a2 req-b4935854-8b88-4104-aabb-497eb487da61 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033729 Sep 06 22:47:58.943765 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 327/645] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:47:59.303450 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7652b4da-b56d-40be-8c5b-94385e316c32 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:47:59.304530 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7652b4da-b56d-40be-8c5b-94385e316c32 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:47:59.310961 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7652b4da-b56d-40be-8c5b-94385e316c32 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:59.311453 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7652b4da-b56d-40be-8c5b-94385e316c32 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:59.311889 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7652b4da-b56d-40be-8c5b-94385e316c32 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:59.312589 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7652b4da-b56d-40be-8c5b-94385e316c32 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:59.313068 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7652b4da-b56d-40be-8c5b-94385e316c32 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:59.313490 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7652b4da-b56d-40be-8c5b-94385e316c32 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:59.334004 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:47:59.348097 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7652b4da-b56d-40be-8c5b-94385e316c32 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:47:59.348580 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7652b4da-b56d-40be-8c5b-94385e316c32 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:47:59.349043 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7652b4da-b56d-40be-8c5b-94385e316c32 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:47:59.349485 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-7652b4da-b56d-40be-8c5b-94385e316c32 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lazy-loading 'fault' on Instance uuid 7b07b208-45e2-45aa-ad7b-bede527cfb6d {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 22:47:59.391224 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7652b4da-b56d-40be-8c5b-94385e316c32 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:47:59.399856 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7652b4da-b56d-40be-8c5b-94385e316c32 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 200 len: 1336 microversion: 2.1 time: 0.100469 Sep 06 22:47:59.400431 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 319/646] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:47:59 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 1336 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:48:00.420255 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 22:48:00.420864 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Tue Sep 6 22:48:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d (ip 10.222.0.39) !!! Sep 06 22:48:00.425288 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-853c0261-0f34-4322-94aa-26e40014feb7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:00.425973 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-853c0261-0f34-4322-94aa-26e40014feb7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 7b07b208-45e2-45aa-ad7b-bede527cfb6d] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:00.434352 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-853c0261-0f34-4322-94aa-26e40014feb7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:00.435064 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-853c0261-0f34-4322-94aa-26e40014feb7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:00.435705 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-853c0261-0f34-4322-94aa-26e40014feb7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:00.436736 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-853c0261-0f34-4322-94aa-26e40014feb7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:00.437441 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-853c0261-0f34-4322-94aa-26e40014feb7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:00.438072 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-853c0261-0f34-4322-94aa-26e40014feb7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:00.458358 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-853c0261-0f34-4322-94aa-26e40014feb7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] HTTP exception thrown: Instance 7b07b208-45e2-45aa-ad7b-bede527cfb6d could not be found. Sep 06 22:48:00.461216 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-853c0261-0f34-4322-94aa-26e40014feb7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Request method failure captured: Sep 06 22:48:00.461216 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: request: GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d HTTP/1.1 Sep 06 22:48:00.461216 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept: application/json Sep 06 22:48:00.461216 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Sep 06 22:48:00.461216 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Connection: close Sep 06 22:48:00.461216 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Length: 0 Sep 06 22:48:00.461216 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Type: application/json Sep 06 22:48:00.461216 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Host: 10.222.0.39 Sep 06 22:48:00.461216 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Sep 06 22:48:00.461216 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.12 Sep 06 22:48:00.461216 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABjF8zr3ZzLjA2gwI7YEUt9cbBvmbp_x4ePSTIy-YRHBGO1km1XYQsyRXo1bKQtaluJ7IZzwPTYhu0Q2-OK1qDco29jAZu8GJ0xy8vIJ8lATrAGg8YhLEoTAMLN9QKkngqWKdXs7keDyDgD2zskPjbWbA9c5uX7NbZdbQA8YqfAuMZMfA0 Sep 06 22:48:00.461216 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Sep 06 22:48:00.461216 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Sep 06 22:48:00.461216 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Sep 06 22:48:00.461216 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Sep 06 22:48:00.461216 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Sep 06 22:48:00.461216 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Sep 06 22:48:00.461216 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Id: 84c39ea86193481fa08158197629ea85 Sep 06 22:48:00.461216 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1404608848 Sep 06 22:48:00.461216 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Role: reader,member Sep 06 22:48:00.461216 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Sep 06 22:48:00.462713 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/84c39ea86193481fa08158197629ea85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_84c39ea86193481fa08158197629ea85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/84c39ea86193481fa08158197629ea85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/84c39ea86193481fa08158197629ea85"}]}] Sep 06 22:48:00.462713 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1404608848 Sep 06 22:48:00.462713 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 84c39ea86193481fa08158197629ea85 Sep 06 22:48:00.462713 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1404608848 Sep 06 22:48:00.462713 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User: tempest-ServerRescueNegativeTestJSON-1404608848-project Sep 06 22:48:00.462713 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Sep 06 22:48:00.462713 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Sep 06 22:48:00.462713 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Id: 2945d87f1c114dd0b42c4e58a8133e76 Sep 06 22:48:00.462713 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1404608848-project Sep 06 22:48:00.462713 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: method: > Sep 06 22:48:00.462713 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: exception: Instance 7b07b208-45e2-45aa-ad7b-bede527cfb6d could not be found. Sep 06 22:48:00.462713 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: action_args: {'id': '7b07b208-45e2-45aa-ad7b-bede527cfb6d'} Sep 06 22:48:00.463671 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:48:00.463671 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:48:00.463671 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:48:00.463671 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:48:00.463671 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:48:00.463671 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:48:00.463671 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:48:00.463671 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:48:00.463671 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:48:00.463671 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:48:00.463671 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b07b208-45e2-45aa-ad7b-bede527cfb6d could not be found. Sep 06 22:48:00.463671 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:48:00.463671 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:48:00.463671 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:48:00.463671 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:48:00.463671 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:48:00.463671 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:48:00.463671 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:48:00.463671 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:48:00.463671 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:48:00.464983 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:48:00.464983 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 22:48:00.464983 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 22:48:00.464983 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:48:00.464983 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:48:00.464983 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:48:00.464983 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:48:00.464983 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b07b208-45e2-45aa-ad7b-bede527cfb6d could not be found. Sep 06 22:48:00.464983 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:48:00.464983 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:48:00.464983 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:48:00.464983 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:48:00.464983 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:48:00.464983 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:48:00.464983 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:48:00.464983 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:48:00.464983 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b07b208-45e2-45aa-ad7b-bede527cfb6d could not be found. Sep 06 22:48:00.464983 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:48:00.466450 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-853c0261-0f34-4322-94aa-26e40014feb7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Returning 404 to user: Instance 7b07b208-45e2-45aa-ad7b-bede527cfb6d could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:48:00.466450 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-853c0261-0f34-4322-94aa-26e40014feb7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d" status: 404 len: 111 microversion: 2.1 time: 0.044071 Sep 06 22:48:00.466450 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 328/647] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:48:00 2022] GET /compute/v2.1/servers/7b07b208-45e2-45aa-ad7b-bede527cfb6d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 22:48:00.473894 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-62c3ff0c-2fe7-4dcd-adef-800f0b93c0b8 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '.version_select at 0x7f9c4f6831f0>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:00.494527 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-62c3ff0c-2fe7-4dcd-adef-800f0b93c0b8 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1585207196" status: 202 len: 0 microversion: 2.1 time: 0.024476 Sep 06 22:48:00.495098 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 320/648] 10.222.0.39 () {58 vars in 1221 bytes} [Tue Sep 6 22:48:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1585207196 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 22:48:03.626517 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-c577af22-f43b-4de0-91b3-c836b867ccd6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:03.627008 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-c577af22-f43b-4de0-91b3-c836b867ccd6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:03.633644 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c577af22-f43b-4de0-91b3-c836b867ccd6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:03.634118 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c577af22-f43b-4de0-91b3-c836b867ccd6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:03.634542 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c577af22-f43b-4de0-91b3-c836b867ccd6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:03.635217 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c577af22-f43b-4de0-91b3-c836b867ccd6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:03.635657 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c577af22-f43b-4de0-91b3-c836b867ccd6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:03.636070 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c577af22-f43b-4de0-91b3-c836b867ccd6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:03.660314 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-c577af22-f43b-4de0-91b3-c836b867ccd6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Going to try to terminate instance {{(pid=127087) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 22:48:03.734084 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-c577af22-f43b-4de0-91b3-c836b867ccd6 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "DELETE /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 204 len: 0 microversion: 2.1 time: 0.111131 Sep 06 22:48:03.734658 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 329/649] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Sep 6 22:48:03 2022] DELETE /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 22:48:03.743712 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a5aa18a1-2891-48bd-9d09-89d97e92dcc7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:03.744346 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a5aa18a1-2891-48bd-9d09-89d97e92dcc7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:03.750879 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5aa18a1-2891-48bd-9d09-89d97e92dcc7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:03.751353 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5aa18a1-2891-48bd-9d09-89d97e92dcc7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:03.751779 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5aa18a1-2891-48bd-9d09-89d97e92dcc7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:03.752460 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5aa18a1-2891-48bd-9d09-89d97e92dcc7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:03.752972 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5aa18a1-2891-48bd-9d09-89d97e92dcc7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:03.753391 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a5aa18a1-2891-48bd-9d09-89d97e92dcc7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:03.877865 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a5aa18a1-2891-48bd-9d09-89d97e92dcc7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:03.885930 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a5aa18a1-2891-48bd-9d09-89d97e92dcc7 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1509 microversion: 2.1 time: 0.146955 Sep 06 22:48:03.886492 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 321/650] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:48:03 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1509 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:48:04.909625 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e20ba335-4c9f-42f0-914a-2b78fa286dd3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:04.910686 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e20ba335-4c9f-42f0-914a-2b78fa286dd3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:04.917722 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e20ba335-4c9f-42f0-914a-2b78fa286dd3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:04.918204 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e20ba335-4c9f-42f0-914a-2b78fa286dd3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:04.918643 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e20ba335-4c9f-42f0-914a-2b78fa286dd3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:04.919325 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e20ba335-4c9f-42f0-914a-2b78fa286dd3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:04.919776 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e20ba335-4c9f-42f0-914a-2b78fa286dd3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:04.920194 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e20ba335-4c9f-42f0-914a-2b78fa286dd3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:05.052956 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e20ba335-4c9f-42f0-914a-2b78fa286dd3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:05.064579 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e20ba335-4c9f-42f0-914a-2b78fa286dd3 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1509 microversion: 2.1 time: 0.158238 Sep 06 22:48:05.073507 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 330/651] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:48:04 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:48:06.090627 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a34c5e66-607b-4306-bf0b-0d7d0b87f13f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:06.091159 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a34c5e66-607b-4306-bf0b-0d7d0b87f13f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:06.097707 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a34c5e66-607b-4306-bf0b-0d7d0b87f13f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:06.098143 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a34c5e66-607b-4306-bf0b-0d7d0b87f13f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:06.098579 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a34c5e66-607b-4306-bf0b-0d7d0b87f13f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:06.099264 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a34c5e66-607b-4306-bf0b-0d7d0b87f13f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:06.099743 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a34c5e66-607b-4306-bf0b-0d7d0b87f13f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:06.100728 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a34c5e66-607b-4306-bf0b-0d7d0b87f13f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:06.231369 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a34c5e66-607b-4306-bf0b-0d7d0b87f13f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:06.238910 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a34c5e66-607b-4306-bf0b-0d7d0b87f13f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1509 microversion: 2.1 time: 0.152230 Sep 06 22:48:06.239465 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 322/652] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:48:06 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:48:06.783853 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-0f505b59-5377-4442-99f9-d24edcb92751 req-2b1fa79e-a456-4eac-b66a-2b1fa76ec78c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea64584-7d61-47f0-8296-25586329f9b5", "name": "network-vif-deleted", "tag": "dad54419-8127-4e01-9006-f6c4183bdfa4"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:48:06.798861 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-0f505b59-5377-4442-99f9-d24edcb92751 req-2b1fa79e-a456-4eac-b66a-2b1fa76ec78c service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:06.799594 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-0f505b59-5377-4442-99f9-d24edcb92751 req-2b1fa79e-a456-4eac-b66a-2b1fa76ec78c service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:06.800012 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-0f505b59-5377-4442-99f9-d24edcb92751 req-2b1fa79e-a456-4eac-b66a-2b1fa76ec78c service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:06.814046 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-0f505b59-5377-4442-99f9-d24edcb92751 req-2b1fa79e-a456-4eac-b66a-2b1fa76ec78c service nova] Creating event network-vif-deleted:dad54419-8127-4e01-9006-f6c4183bdfa4 for instance eea64584-7d61-47f0-8296-25586329f9b5 on hv-cinder-85220 Sep 06 22:48:06.819337 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-0f505b59-5377-4442-99f9-d24edcb92751 req-2b1fa79e-a456-4eac-b66a-2b1fa76ec78c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039097 Sep 06 22:48:06.821441 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 331/653] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:48:07.263057 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4d7a2d5c-203a-49e1-9e35-09d9402e7507 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:07.263662 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4d7a2d5c-203a-49e1-9e35-09d9402e7507 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:07.270021 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d7a2d5c-203a-49e1-9e35-09d9402e7507 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:07.270493 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d7a2d5c-203a-49e1-9e35-09d9402e7507 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:07.270916 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d7a2d5c-203a-49e1-9e35-09d9402e7507 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:07.271605 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d7a2d5c-203a-49e1-9e35-09d9402e7507 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:07.272692 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d7a2d5c-203a-49e1-9e35-09d9402e7507 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:07.273297 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d7a2d5c-203a-49e1-9e35-09d9402e7507 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:07.302927 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d7a2d5c-203a-49e1-9e35-09d9402e7507 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:07.303399 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d7a2d5c-203a-49e1-9e35-09d9402e7507 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:07.303820 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4d7a2d5c-203a-49e1-9e35-09d9402e7507 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:07.304251 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-4d7a2d5c-203a-49e1-9e35-09d9402e7507 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lazy-loading 'fault' on Instance uuid eea64584-7d61-47f0-8296-25586329f9b5 {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 22:48:07.345319 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4d7a2d5c-203a-49e1-9e35-09d9402e7507 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:07.353302 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4d7a2d5c-203a-49e1-9e35-09d9402e7507 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 200 len: 1312 microversion: 2.1 time: 0.094099 Sep 06 22:48:07.360671 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 323/654] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:48:07 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 1312 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:48:08.375992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-130a584e-6fc3-4262-8389-4df2c695aebd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:08.376685 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-130a584e-6fc3-4262-8389-4df2c695aebd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: eea64584-7d61-47f0-8296-25586329f9b5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:08.384443 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-130a584e-6fc3-4262-8389-4df2c695aebd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:08.384953 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-130a584e-6fc3-4262-8389-4df2c695aebd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:08.385388 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-130a584e-6fc3-4262-8389-4df2c695aebd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:08.386074 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-130a584e-6fc3-4262-8389-4df2c695aebd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:08.386523 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-130a584e-6fc3-4262-8389-4df2c695aebd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:08.386941 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-130a584e-6fc3-4262-8389-4df2c695aebd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:08.401176 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-130a584e-6fc3-4262-8389-4df2c695aebd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] HTTP exception thrown: Instance eea64584-7d61-47f0-8296-25586329f9b5 could not be found. Sep 06 22:48:08.402778 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-130a584e-6fc3-4262-8389-4df2c695aebd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Request method failure captured: Sep 06 22:48:08.402778 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: request: GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 HTTP/1.1 Sep 06 22:48:08.402778 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept: application/json Sep 06 22:48:08.402778 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Sep 06 22:48:08.402778 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Connection: close Sep 06 22:48:08.402778 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Length: 0 Sep 06 22:48:08.402778 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Type: application/json Sep 06 22:48:08.402778 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Host: 10.222.0.39 Sep 06 22:48:08.402778 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Sep 06 22:48:08.402778 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.12 Sep 06 22:48:08.402778 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABjF8zr3ZzLjA2gwI7YEUt9cbBvmbp_x4ePSTIy-YRHBGO1km1XYQsyRXo1bKQtaluJ7IZzwPTYhu0Q2-OK1qDco29jAZu8GJ0xy8vIJ8lATrAGg8YhLEoTAMLN9QKkngqWKdXs7keDyDgD2zskPjbWbA9c5uX7NbZdbQA8YqfAuMZMfA0 Sep 06 22:48:08.402778 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Sep 06 22:48:08.402778 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Sep 06 22:48:08.402778 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Sep 06 22:48:08.402778 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Sep 06 22:48:08.402778 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Sep 06 22:48:08.402778 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Sep 06 22:48:08.402778 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Id: 84c39ea86193481fa08158197629ea85 Sep 06 22:48:08.402778 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1404608848 Sep 06 22:48:08.402778 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Role: reader,member Sep 06 22:48:08.402778 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Sep 06 22:48:08.404407 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/84c39ea86193481fa08158197629ea85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_84c39ea86193481fa08158197629ea85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/84c39ea86193481fa08158197629ea85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/84c39ea86193481fa08158197629ea85"}]}] Sep 06 22:48:08.404407 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1404608848 Sep 06 22:48:08.404407 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 84c39ea86193481fa08158197629ea85 Sep 06 22:48:08.404407 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1404608848 Sep 06 22:48:08.404407 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User: tempest-ServerRescueNegativeTestJSON-1404608848-project Sep 06 22:48:08.404407 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Sep 06 22:48:08.404407 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Sep 06 22:48:08.404407 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Id: 2945d87f1c114dd0b42c4e58a8133e76 Sep 06 22:48:08.404407 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1404608848-project Sep 06 22:48:08.404407 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: method: > Sep 06 22:48:08.404407 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: exception: Instance eea64584-7d61-47f0-8296-25586329f9b5 could not be found. Sep 06 22:48:08.404407 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: action_args: {'id': 'eea64584-7d61-47f0-8296-25586329f9b5'} Sep 06 22:48:08.405354 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:48:08.405354 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:48:08.405354 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:48:08.405354 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:48:08.405354 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:48:08.405354 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:48:08.405354 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:48:08.405354 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:48:08.405354 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:48:08.405354 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:48:08.405354 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eea64584-7d61-47f0-8296-25586329f9b5 could not be found. Sep 06 22:48:08.405354 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:48:08.405354 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:48:08.405354 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:48:08.405354 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:48:08.405354 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:48:08.405354 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:48:08.405354 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:48:08.405354 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:48:08.405354 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:48:08.406652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:48:08.406652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 22:48:08.406652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 22:48:08.406652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:48:08.406652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:48:08.406652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:48:08.406652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:48:08.406652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eea64584-7d61-47f0-8296-25586329f9b5 could not be found. Sep 06 22:48:08.406652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:48:08.406652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:48:08.406652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:48:08.406652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:48:08.406652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:48:08.406652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:48:08.406652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:48:08.406652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:48:08.406652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eea64584-7d61-47f0-8296-25586329f9b5 could not be found. Sep 06 22:48:08.406652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:48:08.407734 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-130a584e-6fc3-4262-8389-4df2c695aebd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Returning 404 to user: Instance eea64584-7d61-47f0-8296-25586329f9b5 could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:48:08.407734 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-130a584e-6fc3-4262-8389-4df2c695aebd tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5" status: 404 len: 111 microversion: 2.1 time: 0.032432 Sep 06 22:48:08.407734 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 332/655] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:48:08 2022] GET /compute/v2.1/servers/eea64584-7d61-47f0-8296-25586329f9b5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 22:48:08.412735 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3730f0f2-e429-4b2c-aa2b-52f34ce3af0f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:08.413245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3730f0f2-e429-4b2c-aa2b-52f34ce3af0f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 5bcd7a9d-c2c8-489c-9827-b6be1508d63c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:08.419679 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3730f0f2-e429-4b2c-aa2b-52f34ce3af0f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:08.420156 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3730f0f2-e429-4b2c-aa2b-52f34ce3af0f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:08.420581 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3730f0f2-e429-4b2c-aa2b-52f34ce3af0f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:08.421290 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3730f0f2-e429-4b2c-aa2b-52f34ce3af0f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:08.421738 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3730f0f2-e429-4b2c-aa2b-52f34ce3af0f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:08.422153 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3730f0f2-e429-4b2c-aa2b-52f34ce3af0f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:08.447476 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3730f0f2-e429-4b2c-aa2b-52f34ce3af0f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 5bcd7a9d-c2c8-489c-9827-b6be1508d63c] Going to try to terminate instance {{(pid=127088) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 22:48:08.534169 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3730f0f2-e429-4b2c-aa2b-52f34ce3af0f tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c" status: 204 len: 0 microversion: 2.1 time: 0.125038 Sep 06 22:48:08.534895 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 324/656] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Sep 6 22:48:08 2022] DELETE /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 22:48:08.543168 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-22d6b27e-3a33-4925-b67a-37f402730508 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:08.543804 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-22d6b27e-3a33-4925-b67a-37f402730508 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 5bcd7a9d-c2c8-489c-9827-b6be1508d63c] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:08.549818 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-22d6b27e-3a33-4925-b67a-37f402730508 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:08.550316 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-22d6b27e-3a33-4925-b67a-37f402730508 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:08.550732 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-22d6b27e-3a33-4925-b67a-37f402730508 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:08.551419 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-22d6b27e-3a33-4925-b67a-37f402730508 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:08.551868 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-22d6b27e-3a33-4925-b67a-37f402730508 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:08.552286 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-22d6b27e-3a33-4925-b67a-37f402730508 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:08.683910 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-22d6b27e-3a33-4925-b67a-37f402730508 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:08.691512 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-22d6b27e-3a33-4925-b67a-37f402730508 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c" status: 200 len: 1522 microversion: 2.1 time: 0.152197 Sep 06 22:48:08.692063 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 333/657] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:48:08 2022] GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:48:09.715255 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-35301036-ea9e-4cdf-a592-efe4ee6326ff tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:09.715986 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-35301036-ea9e-4cdf-a592-efe4ee6326ff tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 5bcd7a9d-c2c8-489c-9827-b6be1508d63c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:09.722412 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35301036-ea9e-4cdf-a592-efe4ee6326ff tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:09.722804 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35301036-ea9e-4cdf-a592-efe4ee6326ff tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:09.723229 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35301036-ea9e-4cdf-a592-efe4ee6326ff tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:09.723903 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35301036-ea9e-4cdf-a592-efe4ee6326ff tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:09.724353 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35301036-ea9e-4cdf-a592-efe4ee6326ff tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:09.724872 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35301036-ea9e-4cdf-a592-efe4ee6326ff tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:09.857501 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-35301036-ea9e-4cdf-a592-efe4ee6326ff tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:09.865026 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-35301036-ea9e-4cdf-a592-efe4ee6326ff tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c" status: 200 len: 1522 microversion: 2.1 time: 0.153951 Sep 06 22:48:09.866206 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 325/658] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:48:09 2022] GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:48:10.887423 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-685bb97d-e3af-4858-b449-e51738780e4c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:10.888025 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-685bb97d-e3af-4858-b449-e51738780e4c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 5bcd7a9d-c2c8-489c-9827-b6be1508d63c] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:10.894515 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-685bb97d-e3af-4858-b449-e51738780e4c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:10.894996 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-685bb97d-e3af-4858-b449-e51738780e4c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:10.895446 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-685bb97d-e3af-4858-b449-e51738780e4c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:10.896126 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-685bb97d-e3af-4858-b449-e51738780e4c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:10.896589 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-685bb97d-e3af-4858-b449-e51738780e4c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:10.897567 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-685bb97d-e3af-4858-b449-e51738780e4c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:11.028127 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-685bb97d-e3af-4858-b449-e51738780e4c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:11.035573 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-685bb97d-e3af-4858-b449-e51738780e4c tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c" status: 200 len: 1522 microversion: 2.1 time: 0.152071 Sep 06 22:48:11.036123 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 334/659] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:48:10 2022] GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:48:12.059018 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d0fbc01e-a1e5-4dc0-a451-eee0b8c7b4f1 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:12.059662 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d0fbc01e-a1e5-4dc0-a451-eee0b8c7b4f1 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 5bcd7a9d-c2c8-489c-9827-b6be1508d63c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:12.067238 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d0fbc01e-a1e5-4dc0-a451-eee0b8c7b4f1 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:12.067869 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d0fbc01e-a1e5-4dc0-a451-eee0b8c7b4f1 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:12.068312 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d0fbc01e-a1e5-4dc0-a451-eee0b8c7b4f1 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:12.069124 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d0fbc01e-a1e5-4dc0-a451-eee0b8c7b4f1 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:12.069579 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d0fbc01e-a1e5-4dc0-a451-eee0b8c7b4f1 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:12.070004 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d0fbc01e-a1e5-4dc0-a451-eee0b8c7b4f1 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:12.288454 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d0fbc01e-a1e5-4dc0-a451-eee0b8c7b4f1 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2945d87f1c114dd0b42c4e58a8133e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c39ea86193481fa08158197629ea85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:12.296101 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d0fbc01e-a1e5-4dc0-a451-eee0b8c7b4f1 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c" status: 200 len: 1522 microversion: 2.1 time: 0.241244 Sep 06 22:48:12.296664 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 326/660] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:48:12 2022] GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:48:12.566750 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-7493c5ca-3cbb-4e1e-a18f-c27a95372b73 req-7cede297-383f-45b3-9361-85c70fa5f347 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bcd7a9d-c2c8-489c-9827-b6be1508d63c", "name": "network-vif-deleted", "tag": "20bc1f9d-50d4-4f0b-afe1-3cdbc5f69caa"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:48:12.577415 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-7493c5ca-3cbb-4e1e-a18f-c27a95372b73 req-7cede297-383f-45b3-9361-85c70fa5f347 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:12.577820 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-7493c5ca-3cbb-4e1e-a18f-c27a95372b73 req-7cede297-383f-45b3-9361-85c70fa5f347 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:12.578237 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-7493c5ca-3cbb-4e1e-a18f-c27a95372b73 req-7cede297-383f-45b3-9361-85c70fa5f347 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:12.591759 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-7493c5ca-3cbb-4e1e-a18f-c27a95372b73 req-7cede297-383f-45b3-9361-85c70fa5f347 service nova] Creating event network-vif-deleted:20bc1f9d-50d4-4f0b-afe1-3cdbc5f69caa for instance 5bcd7a9d-c2c8-489c-9827-b6be1508d63c on hv-cinder-85220 Sep 06 22:48:12.598281 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-7493c5ca-3cbb-4e1e-a18f-c27a95372b73 req-7cede297-383f-45b3-9361-85c70fa5f347 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035257 Sep 06 22:48:12.598880 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 335/661] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:48:13.319248 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c7c13f0e-1900-44a1-98b1-b512547ca6f4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:13.319859 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c7c13f0e-1900-44a1-98b1-b512547ca6f4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] [instance: 5bcd7a9d-c2c8-489c-9827-b6be1508d63c] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:13.326336 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c7c13f0e-1900-44a1-98b1-b512547ca6f4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:13.326824 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c7c13f0e-1900-44a1-98b1-b512547ca6f4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:13.327254 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c7c13f0e-1900-44a1-98b1-b512547ca6f4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:13.327935 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c7c13f0e-1900-44a1-98b1-b512547ca6f4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:13.328380 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c7c13f0e-1900-44a1-98b1-b512547ca6f4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:13.328816 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c7c13f0e-1900-44a1-98b1-b512547ca6f4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:13.342098 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-c7c13f0e-1900-44a1-98b1-b512547ca6f4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] HTTP exception thrown: Instance 5bcd7a9d-c2c8-489c-9827-b6be1508d63c could not be found. Sep 06 22:48:13.343746 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c7c13f0e-1900-44a1-98b1-b512547ca6f4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Request method failure captured: Sep 06 22:48:13.343746 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c HTTP/1.1 Sep 06 22:48:13.343746 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept: application/json Sep 06 22:48:13.343746 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Sep 06 22:48:13.343746 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Connection: close Sep 06 22:48:13.343746 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Length: 0 Sep 06 22:48:13.343746 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Type: application/json Sep 06 22:48:13.343746 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Host: 10.222.0.39 Sep 06 22:48:13.343746 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Sep 06 22:48:13.343746 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Sep 06 22:48:13.343746 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjF8zr3ZzLjA2gwI7YEUt9cbBvmbp_x4ePSTIy-YRHBGO1km1XYQsyRXo1bKQtaluJ7IZzwPTYhu0Q2-OK1qDco29jAZu8GJ0xy8vIJ8lATrAGg8YhLEoTAMLN9QKkngqWKdXs7keDyDgD2zskPjbWbA9c5uX7NbZdbQA8YqfAuMZMfA0 Sep 06 22:48:13.343746 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Sep 06 22:48:13.343746 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Sep 06 22:48:13.343746 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Sep 06 22:48:13.343746 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Sep 06 22:48:13.343746 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Sep 06 22:48:13.343746 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Sep 06 22:48:13.343746 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Id: 84c39ea86193481fa08158197629ea85 Sep 06 22:48:13.343746 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1404608848 Sep 06 22:48:13.343746 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Role: reader,member Sep 06 22:48:13.343746 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Sep 06 22:48:13.345397 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/84c39ea86193481fa08158197629ea85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_84c39ea86193481fa08158197629ea85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/84c39ea86193481fa08158197629ea85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/84c39ea86193481fa08158197629ea85"}]}] Sep 06 22:48:13.345397 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1404608848 Sep 06 22:48:13.345397 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 84c39ea86193481fa08158197629ea85 Sep 06 22:48:13.345397 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1404608848 Sep 06 22:48:13.345397 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User: tempest-ServerRescueNegativeTestJSON-1404608848-project Sep 06 22:48:13.345397 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Sep 06 22:48:13.345397 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Sep 06 22:48:13.345397 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Id: 2945d87f1c114dd0b42c4e58a8133e76 Sep 06 22:48:13.345397 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1404608848-project Sep 06 22:48:13.345397 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: method: > Sep 06 22:48:13.345397 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: exception: Instance 5bcd7a9d-c2c8-489c-9827-b6be1508d63c could not be found. Sep 06 22:48:13.345397 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: action_args: {'id': '5bcd7a9d-c2c8-489c-9827-b6be1508d63c'} Sep 06 22:48:13.346347 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:48:13.346347 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:48:13.346347 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:48:13.346347 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:48:13.346347 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:48:13.346347 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:48:13.346347 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:48:13.346347 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:48:13.346347 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:48:13.346347 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:48:13.346347 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bcd7a9d-c2c8-489c-9827-b6be1508d63c could not be found. Sep 06 22:48:13.346347 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:48:13.346347 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:48:13.346347 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:48:13.346347 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:48:13.346347 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:48:13.346347 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:48:13.346347 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:48:13.346347 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:48:13.346347 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:48:13.347610 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:48:13.347610 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 22:48:13.347610 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 22:48:13.347610 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:48:13.347610 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:48:13.347610 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:48:13.347610 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:48:13.347610 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bcd7a9d-c2c8-489c-9827-b6be1508d63c could not be found. Sep 06 22:48:13.347610 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:48:13.347610 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:48:13.347610 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:48:13.347610 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:48:13.347610 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:48:13.347610 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:48:13.347610 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:48:13.347610 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:48:13.347610 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bcd7a9d-c2c8-489c-9827-b6be1508d63c could not be found. Sep 06 22:48:13.347610 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:48:13.349075 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c7c13f0e-1900-44a1-98b1-b512547ca6f4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] Returning 404 to user: Instance 5bcd7a9d-c2c8-489c-9827-b6be1508d63c could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:48:13.349075 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c7c13f0e-1900-44a1-98b1-b512547ca6f4 tempest-ServerRescueNegativeTestJSON-1404608848 tempest-ServerRescueNegativeTestJSON-1404608848-project] 10.222.0.39 "GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c" status: 404 len: 111 microversion: 2.1 time: 0.029845 Sep 06 22:48:13.349075 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 327/662] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:48:13 2022] GET /compute/v2.1/servers/5bcd7a9d-c2c8-489c-9827-b6be1508d63c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 22:48:17.711279 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a39d88cd-eb80-4df0-a3bc-8328cb3cc17c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:17.712215 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-a39d88cd-eb80-4df0-a3bc-8328cb3cc17c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:17.718179 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a39d88cd-eb80-4df0-a3bc-8328cb3cc17c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:17.718645 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a39d88cd-eb80-4df0-a3bc-8328cb3cc17c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:17.719257 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a39d88cd-eb80-4df0-a3bc-8328cb3cc17c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:17.719960 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a39d88cd-eb80-4df0-a3bc-8328cb3cc17c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:17.720398 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a39d88cd-eb80-4df0-a3bc-8328cb3cc17c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:17.720836 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a39d88cd-eb80-4df0-a3bc-8328cb3cc17c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:17.747316 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-a39d88cd-eb80-4df0-a3bc-8328cb3cc17c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5/ips" status: 200 len: 152 microversion: 2.20 time: 0.212388 Sep 06 22:48:17.753093 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 336/663] 10.222.0.39 () {60 vars in 1289 bytes} [Tue Sep 6 22:48:17 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5/ips => generated 152 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 22:48:20.061333 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d935d749-6e4d-44ac-9266-6bd1e85af9fe tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:48:20.061863 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d935d749-6e4d-44ac-9266-6bd1e85af9fe tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:20.064571 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:48:20.071755 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d935d749-6e4d-44ac-9266-6bd1e85af9fe tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:20.072233 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d935d749-6e4d-44ac-9266-6bd1e85af9fe tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:20.072660 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d935d749-6e4d-44ac-9266-6bd1e85af9fe tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:20.073383 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d935d749-6e4d-44ac-9266-6bd1e85af9fe tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:20.073827 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d935d749-6e4d-44ac-9266-6bd1e85af9fe tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:20.074239 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d935d749-6e4d-44ac-9266-6bd1e85af9fe tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:20.098890 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-d935d749-6e4d-44ac-9266-6bd1e85af9fe tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lazy-loading 'flavor' on Instance uuid c781a9d5-f194-47b8-870d-eab1adcc1ad5 {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 22:48:20.296184 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d935d749-6e4d-44ac-9266-6bd1e85af9fe tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "POST /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5/action" status: 202 len: 0 microversion: 2.20 time: 0.238556 Sep 06 22:48:20.296975 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 328/664] 10.222.0.39 () {62 vars in 1319 bytes} [Tue Sep 6 22:48:20 2022] POST /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 22:48:20.304885 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-aa1eb341-ff4a-42e6-8e51-c2418041756a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:20.305577 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-aa1eb341-ff4a-42e6-8e51-c2418041756a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:20.308096 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:48:20.313791 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-aa1eb341-ff4a-42e6-8e51-c2418041756a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:20.314563 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-aa1eb341-ff4a-42e6-8e51-c2418041756a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:20.315191 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-aa1eb341-ff4a-42e6-8e51-c2418041756a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:20.315995 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-aa1eb341-ff4a-42e6-8e51-c2418041756a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:20.316417 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-aa1eb341-ff4a-42e6-8e51-c2418041756a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:20.317083 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-aa1eb341-ff4a-42e6-8e51-c2418041756a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:20.457841 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-aa1eb341-ff4a-42e6-8e51-c2418041756a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:20.466523 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-aa1eb341-ff4a-42e6-8e51-c2418041756a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:20.468056 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-aa1eb341-ff4a-42e6-8e51-c2418041756a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:20.472375 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-aa1eb341-ff4a-42e6-8e51-c2418041756a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1724 microversion: 2.20 time: 0.171297 Sep 06 22:48:20.472959 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 337/665] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:48:20 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:48:21.498648 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7d16aa1b-a05d-40dc-8186-2de87f35ecaa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:21.499334 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7d16aa1b-a05d-40dc-8186-2de87f35ecaa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:21.505469 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d16aa1b-a05d-40dc-8186-2de87f35ecaa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:21.505941 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d16aa1b-a05d-40dc-8186-2de87f35ecaa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:21.506369 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d16aa1b-a05d-40dc-8186-2de87f35ecaa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:21.507044 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d16aa1b-a05d-40dc-8186-2de87f35ecaa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:21.507638 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d16aa1b-a05d-40dc-8186-2de87f35ecaa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:21.508055 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d16aa1b-a05d-40dc-8186-2de87f35ecaa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:21.650479 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7d16aa1b-a05d-40dc-8186-2de87f35ecaa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:21.660456 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7d16aa1b-a05d-40dc-8186-2de87f35ecaa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:21.660456 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7d16aa1b-a05d-40dc-8186-2de87f35ecaa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:21.662816 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7d16aa1b-a05d-40dc-8186-2de87f35ecaa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1724 microversion: 2.20 time: 0.168878 Sep 06 22:48:21.663383 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 329/666] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:48:21 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:48:22.687671 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-3f578aa1-89f3-422c-81da-dec5e9872ac7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:22.688272 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-3f578aa1-89f3-422c-81da-dec5e9872ac7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:22.694278 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3f578aa1-89f3-422c-81da-dec5e9872ac7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:22.694745 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3f578aa1-89f3-422c-81da-dec5e9872ac7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:22.695305 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3f578aa1-89f3-422c-81da-dec5e9872ac7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:22.695985 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3f578aa1-89f3-422c-81da-dec5e9872ac7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:22.696423 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3f578aa1-89f3-422c-81da-dec5e9872ac7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:22.696865 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3f578aa1-89f3-422c-81da-dec5e9872ac7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:22.830872 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3f578aa1-89f3-422c-81da-dec5e9872ac7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:22.841718 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3f578aa1-89f3-422c-81da-dec5e9872ac7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:22.843216 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3f578aa1-89f3-422c-81da-dec5e9872ac7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:22.844475 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-3f578aa1-89f3-422c-81da-dec5e9872ac7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1724 microversion: 2.20 time: 0.160872 Sep 06 22:48:22.845475 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 338/667] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:48:22 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:48:23.870622 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-16a8377d-3a5c-4c03-81be-223c822c0be3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:23.871253 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-16a8377d-3a5c-4c03-81be-223c822c0be3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:23.878622 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-16a8377d-3a5c-4c03-81be-223c822c0be3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:23.879107 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-16a8377d-3a5c-4c03-81be-223c822c0be3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:23.879538 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-16a8377d-3a5c-4c03-81be-223c822c0be3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:23.880233 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-16a8377d-3a5c-4c03-81be-223c822c0be3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:23.880678 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-16a8377d-3a5c-4c03-81be-223c822c0be3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:23.881129 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-16a8377d-3a5c-4c03-81be-223c822c0be3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:24.018192 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-16a8377d-3a5c-4c03-81be-223c822c0be3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:24.027391 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-16a8377d-3a5c-4c03-81be-223c822c0be3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:24.028851 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-16a8377d-3a5c-4c03-81be-223c822c0be3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:24.030029 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-16a8377d-3a5c-4c03-81be-223c822c0be3 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1724 microversion: 2.20 time: 0.163745 Sep 06 22:48:24.030581 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 330/668] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:48:23 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:48:25.056559 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-18f628d0-f68e-436f-8699-3677c4da772a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:25.057991 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-18f628d0-f68e-436f-8699-3677c4da772a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:25.065558 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-18f628d0-f68e-436f-8699-3677c4da772a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:25.066312 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-18f628d0-f68e-436f-8699-3677c4da772a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:25.066908 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-18f628d0-f68e-436f-8699-3677c4da772a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:25.067659 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-18f628d0-f68e-436f-8699-3677c4da772a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:25.068242 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-18f628d0-f68e-436f-8699-3677c4da772a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:25.068667 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-18f628d0-f68e-436f-8699-3677c4da772a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:25.264872 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-18f628d0-f68e-436f-8699-3677c4da772a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:25.274124 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-18f628d0-f68e-436f-8699-3677c4da772a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:25.275943 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-18f628d0-f68e-436f-8699-3677c4da772a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:25.277121 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-18f628d0-f68e-436f-8699-3677c4da772a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1724 microversion: 2.20 time: 0.225663 Sep 06 22:48:25.277918 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 339/669] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:48:25 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:48:26.302447 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9f8eb9dd-e3b8-4499-a107-cf04d0070fd2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:26.303166 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9f8eb9dd-e3b8-4499-a107-cf04d0070fd2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:26.310574 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f8eb9dd-e3b8-4499-a107-cf04d0070fd2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:26.311631 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f8eb9dd-e3b8-4499-a107-cf04d0070fd2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:26.311925 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f8eb9dd-e3b8-4499-a107-cf04d0070fd2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:26.312643 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f8eb9dd-e3b8-4499-a107-cf04d0070fd2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:26.313314 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f8eb9dd-e3b8-4499-a107-cf04d0070fd2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:26.313917 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f8eb9dd-e3b8-4499-a107-cf04d0070fd2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:26.454736 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9f8eb9dd-e3b8-4499-a107-cf04d0070fd2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:26.465165 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9f8eb9dd-e3b8-4499-a107-cf04d0070fd2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:26.467028 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9f8eb9dd-e3b8-4499-a107-cf04d0070fd2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:26.468196 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9f8eb9dd-e3b8-4499-a107-cf04d0070fd2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1724 microversion: 2.20 time: 0.169612 Sep 06 22:48:26.468741 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 331/670] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:48:26 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:48:27.060275 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b544409c-0258-4b36-bce0-5a75af4bc2c6 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:27.060852 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b544409c-0258-4b36-bce0-5a75af4bc2c6 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 629fd4f8-24b5-4287-bfe2-ba789169bdb3] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:27.067250 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b544409c-0258-4b36-bce0-5a75af4bc2c6 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:27.067931 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b544409c-0258-4b36-bce0-5a75af4bc2c6 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:27.068495 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b544409c-0258-4b36-bce0-5a75af4bc2c6 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:27.069552 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b544409c-0258-4b36-bce0-5a75af4bc2c6 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:27.070125 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b544409c-0258-4b36-bce0-5a75af4bc2c6 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:27.070601 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b544409c-0258-4b36-bce0-5a75af4bc2c6 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:27.073301 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:48:27.097095 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b544409c-0258-4b36-bce0-5a75af4bc2c6 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3/ips" status: 200 len: 143 microversion: 2.1 time: 0.205848 Sep 06 22:48:27.097719 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 340/671] 10.222.0.39 () {58 vars in 1248 bytes} [Tue Sep 6 22:48:26 2022] GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3/ips => generated 143 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:48:27.494771 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9f422376-c3dd-4eac-b8e4-c2d97f1501f0 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:27.495383 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9f422376-c3dd-4eac-b8e4-c2d97f1501f0 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:27.501762 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f422376-c3dd-4eac-b8e4-c2d97f1501f0 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:27.502248 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f422376-c3dd-4eac-b8e4-c2d97f1501f0 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:27.502681 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f422376-c3dd-4eac-b8e4-c2d97f1501f0 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:27.503363 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f422376-c3dd-4eac-b8e4-c2d97f1501f0 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:27.503811 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f422376-c3dd-4eac-b8e4-c2d97f1501f0 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:27.504230 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f422376-c3dd-4eac-b8e4-c2d97f1501f0 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:27.634439 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9f422376-c3dd-4eac-b8e4-c2d97f1501f0 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:27.643036 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9f422376-c3dd-4eac-b8e4-c2d97f1501f0 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:27.644693 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9f422376-c3dd-4eac-b8e4-c2d97f1501f0 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:27.645929 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9f422376-c3dd-4eac-b8e4-c2d97f1501f0 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1724 microversion: 2.20 time: 0.155361 Sep 06 22:48:27.646488 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 332/672] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:48:27 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:48:28.447767 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-663f081c-e3f4-48f1-a9b5-28d8acd7e88f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2dc93dc5-63ee-4c00-a5c2-e8ff4087a912"}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:48:28.450125 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-663f081c-e3f4-48f1-a9b5-28d8acd7e88f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 629fd4f8-24b5-4287-bfe2-ba789169bdb3] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:28.456741 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-663f081c-e3f4-48f1-a9b5-28d8acd7e88f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:28.457249 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-663f081c-e3f4-48f1-a9b5-28d8acd7e88f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:28.457770 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-663f081c-e3f4-48f1-a9b5-28d8acd7e88f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:28.458344 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-663f081c-e3f4-48f1-a9b5-28d8acd7e88f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:28.463332 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-663f081c-e3f4-48f1-a9b5-28d8acd7e88f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:28.463896 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-663f081c-e3f4-48f1-a9b5-28d8acd7e88f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:28.671692 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a8a29aee-7638-4b46-b1f4-d6a21517788a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:28.672295 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a8a29aee-7638-4b46-b1f4-d6a21517788a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:28.678913 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a8a29aee-7638-4b46-b1f4-d6a21517788a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:28.679397 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a8a29aee-7638-4b46-b1f4-d6a21517788a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:28.680380 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a8a29aee-7638-4b46-b1f4-d6a21517788a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:28.681277 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a8a29aee-7638-4b46-b1f4-d6a21517788a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:28.681733 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a8a29aee-7638-4b46-b1f4-d6a21517788a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:28.682151 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a8a29aee-7638-4b46-b1f4-d6a21517788a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:28.702265 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:48:28.709904 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-663f081c-e3f4-48f1-a9b5-28d8acd7e88f tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "POST /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266758 Sep 06 22:48:28.711081 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 341/673] 10.222.0.39 () {60 vars in 1323 bytes} [Tue Sep 6 22:48:28 2022] POST /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:48:28.832229 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a8a29aee-7638-4b46-b1f4-d6a21517788a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:28.841033 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a8a29aee-7638-4b46-b1f4-d6a21517788a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:28.842477 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a8a29aee-7638-4b46-b1f4-d6a21517788a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:28.843616 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a8a29aee-7638-4b46-b1f4-d6a21517788a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1724 microversion: 2.20 time: 0.175877 Sep 06 22:48:28.844166 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 333/674] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:48:28 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 22:48:29.870650 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-3b8ea59e-900d-4fe7-ab1d-4df83607b227 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:29.871329 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-3b8ea59e-900d-4fe7-ab1d-4df83607b227 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:29.877580 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3b8ea59e-900d-4fe7-ab1d-4df83607b227 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:29.878059 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3b8ea59e-900d-4fe7-ab1d-4df83607b227 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:29.878507 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3b8ea59e-900d-4fe7-ab1d-4df83607b227 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:29.879186 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3b8ea59e-900d-4fe7-ab1d-4df83607b227 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:29.879627 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3b8ea59e-900d-4fe7-ab1d-4df83607b227 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:29.880039 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3b8ea59e-900d-4fe7-ab1d-4df83607b227 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:30.052276 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3b8ea59e-900d-4fe7-ab1d-4df83607b227 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:30.060967 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3b8ea59e-900d-4fe7-ab1d-4df83607b227 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:30.069180 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3b8ea59e-900d-4fe7-ab1d-4df83607b227 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:30.070388 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-3b8ea59e-900d-4fe7-ab1d-4df83607b227 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1724 microversion: 2.20 time: 0.205071 Sep 06 22:48:30.071816 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 342/675] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:48:29 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:48:31.096123 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a094dba2-63a2-43f0-8381-9e74bbbe77ff tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:31.096793 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a094dba2-63a2-43f0-8381-9e74bbbe77ff tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:31.103993 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a094dba2-63a2-43f0-8381-9e74bbbe77ff tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:31.104475 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a094dba2-63a2-43f0-8381-9e74bbbe77ff tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:31.105015 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a094dba2-63a2-43f0-8381-9e74bbbe77ff tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:31.105706 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a094dba2-63a2-43f0-8381-9e74bbbe77ff tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:31.106157 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a094dba2-63a2-43f0-8381-9e74bbbe77ff tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:31.106577 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a094dba2-63a2-43f0-8381-9e74bbbe77ff tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:31.247908 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a094dba2-63a2-43f0-8381-9e74bbbe77ff tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:31.256617 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a094dba2-63a2-43f0-8381-9e74bbbe77ff tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:31.261198 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a094dba2-63a2-43f0-8381-9e74bbbe77ff tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:31.262406 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a094dba2-63a2-43f0-8381-9e74bbbe77ff tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1724 microversion: 2.20 time: 0.170528 Sep 06 22:48:31.262986 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 334/676] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:48:31 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:48:32.288076 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-88d2509e-9798-4021-8f8c-ab84df74eaf2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:32.288728 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-88d2509e-9798-4021-8f8c-ab84df74eaf2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:32.295799 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-88d2509e-9798-4021-8f8c-ab84df74eaf2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:32.296267 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-88d2509e-9798-4021-8f8c-ab84df74eaf2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:32.296689 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-88d2509e-9798-4021-8f8c-ab84df74eaf2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:32.297776 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-88d2509e-9798-4021-8f8c-ab84df74eaf2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:32.298219 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-88d2509e-9798-4021-8f8c-ab84df74eaf2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:32.298628 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-88d2509e-9798-4021-8f8c-ab84df74eaf2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:32.433660 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-88d2509e-9798-4021-8f8c-ab84df74eaf2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:32.441600 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-88d2509e-9798-4021-8f8c-ab84df74eaf2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:32.443040 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-88d2509e-9798-4021-8f8c-ab84df74eaf2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:32.444168 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-88d2509e-9798-4021-8f8c-ab84df74eaf2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1724 microversion: 2.20 time: 0.160113 Sep 06 22:48:32.444717 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 343/677] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:48:32 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:48:33.470133 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7b620ce9-a96e-426e-995b-be0d54e64eef tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:33.470739 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7b620ce9-a96e-426e-995b-be0d54e64eef tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:33.477116 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7b620ce9-a96e-426e-995b-be0d54e64eef tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:33.477596 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7b620ce9-a96e-426e-995b-be0d54e64eef tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:33.478032 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7b620ce9-a96e-426e-995b-be0d54e64eef tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:33.478718 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7b620ce9-a96e-426e-995b-be0d54e64eef tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:33.479165 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7b620ce9-a96e-426e-995b-be0d54e64eef tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:33.479588 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7b620ce9-a96e-426e-995b-be0d54e64eef tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:33.606714 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7b620ce9-a96e-426e-995b-be0d54e64eef tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:33.614735 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7b620ce9-a96e-426e-995b-be0d54e64eef tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:33.616197 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7b620ce9-a96e-426e-995b-be0d54e64eef tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:33.617383 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7b620ce9-a96e-426e-995b-be0d54e64eef tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1724 microversion: 2.20 time: 0.151195 Sep 06 22:48:33.617945 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 335/678] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:48:33 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:48:34.642425 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-23c61f4b-29f5-489c-9c1e-805466be04f5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:34.643042 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-23c61f4b-29f5-489c-9c1e-805466be04f5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:34.649646 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-23c61f4b-29f5-489c-9c1e-805466be04f5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:34.650206 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-23c61f4b-29f5-489c-9c1e-805466be04f5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:34.650885 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-23c61f4b-29f5-489c-9c1e-805466be04f5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:34.651558 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-23c61f4b-29f5-489c-9c1e-805466be04f5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:34.651999 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-23c61f4b-29f5-489c-9c1e-805466be04f5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:34.652412 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-23c61f4b-29f5-489c-9c1e-805466be04f5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:34.778999 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-23c61f4b-29f5-489c-9c1e-805466be04f5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:34.786936 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-23c61f4b-29f5-489c-9c1e-805466be04f5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:34.788371 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-23c61f4b-29f5-489c-9c1e-805466be04f5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:34.789524 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-23c61f4b-29f5-489c-9c1e-805466be04f5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1724 microversion: 2.20 time: 0.150974 Sep 06 22:48:34.790787 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 344/679] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:48:34 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:48:35.815198 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-66d9c353-2947-45df-8854-ca8a212a666a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:35.815797 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-66d9c353-2947-45df-8854-ca8a212a666a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:35.822355 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-66d9c353-2947-45df-8854-ca8a212a666a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:35.822827 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-66d9c353-2947-45df-8854-ca8a212a666a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:35.823251 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-66d9c353-2947-45df-8854-ca8a212a666a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:35.823926 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-66d9c353-2947-45df-8854-ca8a212a666a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:35.824367 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-66d9c353-2947-45df-8854-ca8a212a666a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:35.824804 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-66d9c353-2947-45df-8854-ca8a212a666a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:35.956084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-66d9c353-2947-45df-8854-ca8a212a666a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:35.964828 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-66d9c353-2947-45df-8854-ca8a212a666a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:35.966293 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-66d9c353-2947-45df-8854-ca8a212a666a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:35.967450 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-66d9c353-2947-45df-8854-ca8a212a666a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1724 microversion: 2.20 time: 0.156204 Sep 06 22:48:35.968012 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 336/680] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:48:35 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:48:36.994329 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-5a0ae152-1b94-4132-a87e-071f1d357a42 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:36.994925 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-5a0ae152-1b94-4132-a87e-071f1d357a42 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:37.001289 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5a0ae152-1b94-4132-a87e-071f1d357a42 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:37.001761 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5a0ae152-1b94-4132-a87e-071f1d357a42 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:37.002182 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5a0ae152-1b94-4132-a87e-071f1d357a42 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:37.002851 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5a0ae152-1b94-4132-a87e-071f1d357a42 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:37.003290 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5a0ae152-1b94-4132-a87e-071f1d357a42 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:37.003698 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5a0ae152-1b94-4132-a87e-071f1d357a42 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:37.130528 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-5a0ae152-1b94-4132-a87e-071f1d357a42 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:37.138713 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-5a0ae152-1b94-4132-a87e-071f1d357a42 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:37.140166 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-5a0ae152-1b94-4132-a87e-071f1d357a42 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:37.141381 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-5a0ae152-1b94-4132-a87e-071f1d357a42 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1724 microversion: 2.20 time: 0.151505 Sep 06 22:48:37.141939 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 345/681] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:48:36 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:48:38.167719 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c81ffdbe-79dd-4876-b53b-a24c3510a6e9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:38.168668 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c81ffdbe-79dd-4876-b53b-a24c3510a6e9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:38.176703 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c81ffdbe-79dd-4876-b53b-a24c3510a6e9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:38.177215 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c81ffdbe-79dd-4876-b53b-a24c3510a6e9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:38.177652 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c81ffdbe-79dd-4876-b53b-a24c3510a6e9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:38.178383 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c81ffdbe-79dd-4876-b53b-a24c3510a6e9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:38.178824 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c81ffdbe-79dd-4876-b53b-a24c3510a6e9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:38.179247 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c81ffdbe-79dd-4876-b53b-a24c3510a6e9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:38.316504 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c81ffdbe-79dd-4876-b53b-a24c3510a6e9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:38.326251 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c81ffdbe-79dd-4876-b53b-a24c3510a6e9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:38.327801 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c81ffdbe-79dd-4876-b53b-a24c3510a6e9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:38.329156 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c81ffdbe-79dd-4876-b53b-a24c3510a6e9 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1724 microversion: 2.20 time: 0.166131 Sep 06 22:48:38.330282 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 337/682] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:48:38 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:48:38.388055 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-5e8f467f-d8d5-4102-812d-e0767f5848ca tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:38.390373 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-5e8f467f-d8d5-4102-812d-e0767f5848ca tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 629fd4f8-24b5-4287-bfe2-ba789169bdb3] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:38.396679 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e8f467f-d8d5-4102-812d-e0767f5848ca tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:38.397200 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e8f467f-d8d5-4102-812d-e0767f5848ca tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:38.397629 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e8f467f-d8d5-4102-812d-e0767f5848ca tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:38.398309 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e8f467f-d8d5-4102-812d-e0767f5848ca tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:38.398758 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e8f467f-d8d5-4102-812d-e0767f5848ca tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:38.399175 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e8f467f-d8d5-4102-812d-e0767f5848ca tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:38.428116 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-5e8f467f-d8d5-4102-812d-e0767f5848ca tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044760 Sep 06 22:48:38.428591 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 346/683] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Sep 6 22:48:38 2022] GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:48:38.439709 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c73a23b9-3236-4d33-9631-670052b68049 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:38.440191 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c73a23b9-3236-4d33-9631-670052b68049 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 629fd4f8-24b5-4287-bfe2-ba789169bdb3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:38.446924 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c73a23b9-3236-4d33-9631-670052b68049 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:38.447599 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c73a23b9-3236-4d33-9631-670052b68049 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:38.448054 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c73a23b9-3236-4d33-9631-670052b68049 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:38.448752 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c73a23b9-3236-4d33-9631-670052b68049 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:38.449222 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c73a23b9-3236-4d33-9631-670052b68049 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:38.449634 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c73a23b9-3236-4d33-9631-670052b68049 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:38.477398 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c73a23b9-3236-4d33-9631-670052b68049 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3/os-volume_attachments/2dc93dc5-63ee-4c00-a5c2-e8ff4087a912" status: 200 len: 194 microversion: 2.1 time: 0.041691 Sep 06 22:48:38.477999 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 338/684] 10.222.0.39 () {58 vars in 1413 bytes} [Tue Sep 6 22:48:38 2022] GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3/os-volume_attachments/2dc93dc5-63ee-4c00-a5c2-e8ff4087a912 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:48:39.356465 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-082a1fdf-1bcf-46f5-a7a3-bc3192fa4388 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:39.357200 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-082a1fdf-1bcf-46f5-a7a3-bc3192fa4388 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:39.363246 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-082a1fdf-1bcf-46f5-a7a3-bc3192fa4388 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:39.363822 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-082a1fdf-1bcf-46f5-a7a3-bc3192fa4388 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:39.364245 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-082a1fdf-1bcf-46f5-a7a3-bc3192fa4388 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:39.365035 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-082a1fdf-1bcf-46f5-a7a3-bc3192fa4388 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:39.365484 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-082a1fdf-1bcf-46f5-a7a3-bc3192fa4388 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:39.365885 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-082a1fdf-1bcf-46f5-a7a3-bc3192fa4388 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:39.509429 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-082a1fdf-1bcf-46f5-a7a3-bc3192fa4388 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:39.517625 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-082a1fdf-1bcf-46f5-a7a3-bc3192fa4388 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:39.519046 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-082a1fdf-1bcf-46f5-a7a3-bc3192fa4388 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:39.520176 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-082a1fdf-1bcf-46f5-a7a3-bc3192fa4388 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1724 microversion: 2.20 time: 0.169250 Sep 06 22:48:39.520725 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 347/685] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:48:39 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:48:39.809044 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d9619d3e-c115-49d9-a72d-23a8bf39d397 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63233d14-6437-4909-9734-5d1c2331e878"}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:48:39.811368 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d9619d3e-c115-49d9-a72d-23a8bf39d397 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 629fd4f8-24b5-4287-bfe2-ba789169bdb3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:39.818003 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9619d3e-c115-49d9-a72d-23a8bf39d397 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:39.818661 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9619d3e-c115-49d9-a72d-23a8bf39d397 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:39.819358 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9619d3e-c115-49d9-a72d-23a8bf39d397 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:39.820168 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9619d3e-c115-49d9-a72d-23a8bf39d397 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:39.820624 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9619d3e-c115-49d9-a72d-23a8bf39d397 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:39.821136 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9619d3e-c115-49d9-a72d-23a8bf39d397 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:40.078266 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d9619d3e-c115-49d9-a72d-23a8bf39d397 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "POST /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274890 Sep 06 22:48:40.079180 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 339/686] 10.222.0.39 () {60 vars in 1323 bytes} [Tue Sep 6 22:48:39 2022] POST /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:48:40.546068 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-851b18e9-68fe-4768-b096-5acb61979841 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:40.546728 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-851b18e9-68fe-4768-b096-5acb61979841 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:40.552947 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-851b18e9-68fe-4768-b096-5acb61979841 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:40.553437 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-851b18e9-68fe-4768-b096-5acb61979841 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:40.553867 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-851b18e9-68fe-4768-b096-5acb61979841 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:40.554556 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-851b18e9-68fe-4768-b096-5acb61979841 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:40.554995 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-851b18e9-68fe-4768-b096-5acb61979841 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:40.555413 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-851b18e9-68fe-4768-b096-5acb61979841 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:40.697097 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-851b18e9-68fe-4768-b096-5acb61979841 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:40.705906 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-851b18e9-68fe-4768-b096-5acb61979841 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:40.707588 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-851b18e9-68fe-4768-b096-5acb61979841 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:40.708791 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-851b18e9-68fe-4768-b096-5acb61979841 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1724 microversion: 2.20 time: 0.166777 Sep 06 22:48:40.709703 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 348/687] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:48:40 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:48:41.735447 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ce070827-fe44-4a6d-be69-85e79316acf7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:41.736130 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ce070827-fe44-4a6d-be69-85e79316acf7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:41.742852 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ce070827-fe44-4a6d-be69-85e79316acf7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:41.743427 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ce070827-fe44-4a6d-be69-85e79316acf7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:41.743741 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ce070827-fe44-4a6d-be69-85e79316acf7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:41.744425 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ce070827-fe44-4a6d-be69-85e79316acf7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:41.744977 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ce070827-fe44-4a6d-be69-85e79316acf7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:41.745290 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ce070827-fe44-4a6d-be69-85e79316acf7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:41.886055 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ce070827-fe44-4a6d-be69-85e79316acf7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:41.894439 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ce070827-fe44-4a6d-be69-85e79316acf7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:41.895952 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ce070827-fe44-4a6d-be69-85e79316acf7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:41.897397 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ce070827-fe44-4a6d-be69-85e79316acf7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1745 microversion: 2.20 time: 0.165980 Sep 06 22:48:41.897676 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 340/688] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:48:41 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:48:42.923480 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-96445c7c-8cde-48bc-9cf0-c0c4c9c51eab tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:42.924083 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-96445c7c-8cde-48bc-9cf0-c0c4c9c51eab tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:42.930594 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-96445c7c-8cde-48bc-9cf0-c0c4c9c51eab tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:42.931066 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-96445c7c-8cde-48bc-9cf0-c0c4c9c51eab tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:42.932008 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-96445c7c-8cde-48bc-9cf0-c0c4c9c51eab tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:42.932748 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-96445c7c-8cde-48bc-9cf0-c0c4c9c51eab tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:42.933218 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-96445c7c-8cde-48bc-9cf0-c0c4c9c51eab tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:42.933627 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-96445c7c-8cde-48bc-9cf0-c0c4c9c51eab tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:43.059209 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-96445c7c-8cde-48bc-9cf0-c0c4c9c51eab tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:43.067154 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-96445c7c-8cde-48bc-9cf0-c0c4c9c51eab tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:43.068659 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-96445c7c-8cde-48bc-9cf0-c0c4c9c51eab tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:43.069827 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-96445c7c-8cde-48bc-9cf0-c0c4c9c51eab tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1745 microversion: 2.20 time: 0.150277 Sep 06 22:48:43.070358 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 349/689] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:48:42 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:48:44.095079 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-278c1fc9-7474-4aa4-b242-8790f2463eab tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:44.095672 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-278c1fc9-7474-4aa4-b242-8790f2463eab tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:44.102018 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-278c1fc9-7474-4aa4-b242-8790f2463eab tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:44.102489 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-278c1fc9-7474-4aa4-b242-8790f2463eab tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:44.102912 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-278c1fc9-7474-4aa4-b242-8790f2463eab tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:44.103700 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-278c1fc9-7474-4aa4-b242-8790f2463eab tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:44.104143 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-278c1fc9-7474-4aa4-b242-8790f2463eab tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:44.104553 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-278c1fc9-7474-4aa4-b242-8790f2463eab tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:44.238885 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-278c1fc9-7474-4aa4-b242-8790f2463eab tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:44.247457 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-278c1fc9-7474-4aa4-b242-8790f2463eab tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:44.248923 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-278c1fc9-7474-4aa4-b242-8790f2463eab tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:44.250068 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-278c1fc9-7474-4aa4-b242-8790f2463eab tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1745 microversion: 2.20 time: 0.158968 Sep 06 22:48:44.250626 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 341/690] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:48:44 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:48:44.446673 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-6f9d1474-f74a-445a-82ef-41da1fffed7d req-22d68920-0687-46d9-adac-1f6b130445a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c781a9d5-f194-47b8-870d-eab1adcc1ad5", "name": "network-vif-plugged", "status": "completed", "tag": "e9150456-138e-49eb-8d2d-f86cecea4bae"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:48:44.456606 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-6f9d1474-f74a-445a-82ef-41da1fffed7d req-22d68920-0687-46d9-adac-1f6b130445a3 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:44.457108 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-6f9d1474-f74a-445a-82ef-41da1fffed7d req-22d68920-0687-46d9-adac-1f6b130445a3 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:44.457534 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-6f9d1474-f74a-445a-82ef-41da1fffed7d req-22d68920-0687-46d9-adac-1f6b130445a3 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:44.468402 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-6f9d1474-f74a-445a-82ef-41da1fffed7d req-22d68920-0687-46d9-adac-1f6b130445a3 service nova] Creating event network-vif-plugged:e9150456-138e-49eb-8d2d-f86cecea4bae for instance c781a9d5-f194-47b8-870d-eab1adcc1ad5 on hv-cinder-85220 Sep 06 22:48:44.473375 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-6f9d1474-f74a-445a-82ef-41da1fffed7d req-22d68920-0687-46d9-adac-1f6b130445a3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169963 Sep 06 22:48:44.473954 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 350/691] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:48:44.534272 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1435dd0f-cf1b-47ce-94ec-3d6572b6fc10 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:44.534921 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1435dd0f-cf1b-47ce-94ec-3d6572b6fc10 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:44.540773 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1435dd0f-cf1b-47ce-94ec-3d6572b6fc10 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:44.541896 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1435dd0f-cf1b-47ce-94ec-3d6572b6fc10 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:44.542327 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1435dd0f-cf1b-47ce-94ec-3d6572b6fc10 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:44.543010 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1435dd0f-cf1b-47ce-94ec-3d6572b6fc10 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:44.543456 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1435dd0f-cf1b-47ce-94ec-3d6572b6fc10 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:44.543873 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1435dd0f-cf1b-47ce-94ec-3d6572b6fc10 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:44.569109 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1435dd0f-cf1b-47ce-94ec-3d6572b6fc10 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] Going to try to terminate instance {{(pid=127088) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 22:48:44.643751 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1435dd0f-cf1b-47ce-94ec-3d6572b6fc10 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126" status: 204 len: 0 microversion: 2.1 time: 0.112848 Sep 06 22:48:44.644245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 342/692] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Sep 6 22:48:44 2022] DELETE /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 22:48:44.653423 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-15d21f1f-702a-497f-b923-fbcc94a7c627 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:44.654112 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-15d21f1f-702a-497f-b923-fbcc94a7c627 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:44.660069 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-15d21f1f-702a-497f-b923-fbcc94a7c627 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:44.660552 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-15d21f1f-702a-497f-b923-fbcc94a7c627 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:44.661020 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-15d21f1f-702a-497f-b923-fbcc94a7c627 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:44.661687 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-15d21f1f-702a-497f-b923-fbcc94a7c627 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:44.662131 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-15d21f1f-702a-497f-b923-fbcc94a7c627 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:44.662549 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-15d21f1f-702a-497f-b923-fbcc94a7c627 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:44.790458 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-15d21f1f-702a-497f-b923-fbcc94a7c627 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:44.798953 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-15d21f1f-702a-497f-b923-fbcc94a7c627 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126" status: 200 len: 1577 microversion: 2.1 time: 0.150072 Sep 06 22:48:44.799514 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 351/693] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:48:44 2022] GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:48:45.276880 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e33fb7df-2c50-4ef9-82b0-5c6ab70bb230 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:45.277569 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e33fb7df-2c50-4ef9-82b0-5c6ab70bb230 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:45.283392 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e33fb7df-2c50-4ef9-82b0-5c6ab70bb230 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:45.283867 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e33fb7df-2c50-4ef9-82b0-5c6ab70bb230 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:45.284294 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e33fb7df-2c50-4ef9-82b0-5c6ab70bb230 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:45.285009 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e33fb7df-2c50-4ef9-82b0-5c6ab70bb230 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:45.285454 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e33fb7df-2c50-4ef9-82b0-5c6ab70bb230 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:45.285867 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e33fb7df-2c50-4ef9-82b0-5c6ab70bb230 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:45.420787 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e33fb7df-2c50-4ef9-82b0-5c6ab70bb230 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:45.429039 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e33fb7df-2c50-4ef9-82b0-5c6ab70bb230 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:45.430560 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e33fb7df-2c50-4ef9-82b0-5c6ab70bb230 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:45.431971 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e33fb7df-2c50-4ef9-82b0-5c6ab70bb230 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1745 microversion: 2.20 time: 0.160470 Sep 06 22:48:45.432525 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 343/694] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:48:45 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:48:45.821789 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-72283477-1bcd-48bc-a247-3b5afd8e46a8 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:45.822924 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-72283477-1bcd-48bc-a247-3b5afd8e46a8 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:45.829247 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-72283477-1bcd-48bc-a247-3b5afd8e46a8 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:45.829726 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-72283477-1bcd-48bc-a247-3b5afd8e46a8 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:45.830153 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-72283477-1bcd-48bc-a247-3b5afd8e46a8 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:45.830833 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-72283477-1bcd-48bc-a247-3b5afd8e46a8 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:45.831281 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-72283477-1bcd-48bc-a247-3b5afd8e46a8 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:45.831696 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-72283477-1bcd-48bc-a247-3b5afd8e46a8 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:45.958170 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-72283477-1bcd-48bc-a247-3b5afd8e46a8 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:45.965974 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-72283477-1bcd-48bc-a247-3b5afd8e46a8 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126" status: 200 len: 1577 microversion: 2.1 time: 0.148100 Sep 06 22:48:45.966541 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 352/695] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:48:45 2022] GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 => generated 1577 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:48:46.460056 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a13f06f4-fa8f-4d2f-9439-0abc1ab60854 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:46.460924 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a13f06f4-fa8f-4d2f-9439-0abc1ab60854 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:46.469622 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a13f06f4-fa8f-4d2f-9439-0abc1ab60854 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:46.470807 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a13f06f4-fa8f-4d2f-9439-0abc1ab60854 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:46.471433 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a13f06f4-fa8f-4d2f-9439-0abc1ab60854 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:46.472300 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a13f06f4-fa8f-4d2f-9439-0abc1ab60854 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:46.472951 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a13f06f4-fa8f-4d2f-9439-0abc1ab60854 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:46.473782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a13f06f4-fa8f-4d2f-9439-0abc1ab60854 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:46.617228 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a13f06f4-fa8f-4d2f-9439-0abc1ab60854 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:46.626131 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a13f06f4-fa8f-4d2f-9439-0abc1ab60854 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:46.627589 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a13f06f4-fa8f-4d2f-9439-0abc1ab60854 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:46.628744 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a13f06f4-fa8f-4d2f-9439-0abc1ab60854 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1740 microversion: 2.20 time: 0.174657 Sep 06 22:48:46.629330 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 344/696] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:48:46 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:48:46.989155 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-7fde4064-98e2-440d-bbd6-9dc33dc44d76 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:46.989783 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-7fde4064-98e2-440d-bbd6-9dc33dc44d76 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:46.996808 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7fde4064-98e2-440d-bbd6-9dc33dc44d76 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:46.997382 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7fde4064-98e2-440d-bbd6-9dc33dc44d76 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:46.997797 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7fde4064-98e2-440d-bbd6-9dc33dc44d76 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:46.998700 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7fde4064-98e2-440d-bbd6-9dc33dc44d76 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:46.999234 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7fde4064-98e2-440d-bbd6-9dc33dc44d76 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:46.999813 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7fde4064-98e2-440d-bbd6-9dc33dc44d76 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:47.003792 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9f34f8a7-c061-440a-a976-97eef7407258 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:48:47.005038 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9f34f8a7-c061-440a-a976-97eef7407258 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:47.012270 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f34f8a7-c061-440a-a976-97eef7407258 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:47.013059 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f34f8a7-c061-440a-a976-97eef7407258 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:47.013630 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f34f8a7-c061-440a-a976-97eef7407258 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:47.014413 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f34f8a7-c061-440a-a976-97eef7407258 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:47.015562 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f34f8a7-c061-440a-a976-97eef7407258 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:47.016171 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f34f8a7-c061-440a-a976-97eef7407258 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:47.040474 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-9f34f8a7-c061-440a-a976-97eef7407258 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lazy-loading 'flavor' on Instance uuid 43a8e21a-339a-4ea5-ad07-4d74e92be9de {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 22:48:47.091297 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:48:47.118821 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9f34f8a7-c061-440a-a976-97eef7407258 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "POST /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de/action" status: 202 len: 0 microversion: 2.1 time: 0.119509 Sep 06 22:48:47.120039 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 345/697] 10.222.0.39 () {60 vars in 1278 bytes} [Tue Sep 6 22:48:46 2022] POST /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 22:48:47.128169 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f4f7948c-0026-496a-804c-edd1f96168b8 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:47.128897 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f4f7948c-0026-496a-804c-edd1f96168b8 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:47.134963 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4f7948c-0026-496a-804c-edd1f96168b8 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:47.135462 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4f7948c-0026-496a-804c-edd1f96168b8 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:47.135861 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4f7948c-0026-496a-804c-edd1f96168b8 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:47.136563 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4f7948c-0026-496a-804c-edd1f96168b8 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:47.137072 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4f7948c-0026-496a-804c-edd1f96168b8 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:47.137493 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4f7948c-0026-496a-804c-edd1f96168b8 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:47.137722 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-7fde4064-98e2-440d-bbd6-9dc33dc44d76 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:47.145708 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-7fde4064-98e2-440d-bbd6-9dc33dc44d76 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126" status: 200 len: 1577 microversion: 2.1 time: 0.160527 Sep 06 22:48:47.160781 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 353/698] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:48:46 2022] GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:48:47.266287 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f4f7948c-0026-496a-804c-edd1f96168b8 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:47.273870 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f4f7948c-0026-496a-804c-edd1f96168b8 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1569 microversion: 2.1 time: 0.149692 Sep 06 22:48:47.274438 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 346/699] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:48:47 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:48:47.659364 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9d805cf1-a6b7-4a21-91bc-1e3915aa027f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:47.660734 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9d805cf1-a6b7-4a21-91bc-1e3915aa027f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:47.669490 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9d805cf1-a6b7-4a21-91bc-1e3915aa027f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:47.670698 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9d805cf1-a6b7-4a21-91bc-1e3915aa027f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:47.671073 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9d805cf1-a6b7-4a21-91bc-1e3915aa027f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:47.672050 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9d805cf1-a6b7-4a21-91bc-1e3915aa027f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:47.672808 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9d805cf1-a6b7-4a21-91bc-1e3915aa027f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:47.673608 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9d805cf1-a6b7-4a21-91bc-1e3915aa027f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:47.953262 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9d805cf1-a6b7-4a21-91bc-1e3915aa027f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:47.963966 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9d805cf1-a6b7-4a21-91bc-1e3915aa027f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:47.968080 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9d805cf1-a6b7-4a21-91bc-1e3915aa027f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:47.977337 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9d805cf1-a6b7-4a21-91bc-1e3915aa027f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1740 microversion: 2.20 time: 0.317514 Sep 06 22:48:47.978219 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 354/700] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:48:47 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1740 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:48:48.170805 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fb22c9c6-42f5-43d8-b16e-16e89b040dbb tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:48.171613 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fb22c9c6-42f5-43d8-b16e-16e89b040dbb tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:48.183151 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fb22c9c6-42f5-43d8-b16e-16e89b040dbb tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:48.192643 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fb22c9c6-42f5-43d8-b16e-16e89b040dbb tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:48.193660 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fb22c9c6-42f5-43d8-b16e-16e89b040dbb tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:48.194599 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fb22c9c6-42f5-43d8-b16e-16e89b040dbb tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:48.195068 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fb22c9c6-42f5-43d8-b16e-16e89b040dbb tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:48.198749 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fb22c9c6-42f5-43d8-b16e-16e89b040dbb tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:48.299177 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-c5843dcc-982e-438e-86b5-80f460774f6c tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:48.299953 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-c5843dcc-982e-438e-86b5-80f460774f6c tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:48.308387 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c5843dcc-982e-438e-86b5-80f460774f6c tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:48.312628 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c5843dcc-982e-438e-86b5-80f460774f6c tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:48.314243 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c5843dcc-982e-438e-86b5-80f460774f6c tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:48.315289 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c5843dcc-982e-438e-86b5-80f460774f6c tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:48.315959 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c5843dcc-982e-438e-86b5-80f460774f6c tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:48.316811 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c5843dcc-982e-438e-86b5-80f460774f6c tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:48.687235 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fb22c9c6-42f5-43d8-b16e-16e89b040dbb tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:48.697963 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fb22c9c6-42f5-43d8-b16e-16e89b040dbb tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126" status: 200 len: 1577 microversion: 2.1 time: 0.531684 Sep 06 22:48:48.699465 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 347/701] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:48:48 2022] GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 => generated 1577 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:48:48.701223 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-c5843dcc-982e-438e-86b5-80f460774f6c tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:48.711027 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-c5843dcc-982e-438e-86b5-80f460774f6c tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1569 microversion: 2.1 time: 0.415817 Sep 06 22:48:48.726256 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 355/702] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:48:48 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1569 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:48:48.766637 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-857504bb-e346-40f3-9288-058c31e2573e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:48.769590 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-857504bb-e346-40f3-9288-058c31e2573e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 629fd4f8-24b5-4287-bfe2-ba789169bdb3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:48.781653 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-857504bb-e346-40f3-9288-058c31e2573e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:48.782404 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-857504bb-e346-40f3-9288-058c31e2573e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:48.783026 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-857504bb-e346-40f3-9288-058c31e2573e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:48.783919 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-857504bb-e346-40f3-9288-058c31e2573e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:48.787522 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-857504bb-e346-40f3-9288-058c31e2573e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:48.788138 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-857504bb-e346-40f3-9288-058c31e2573e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:48.826991 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-857504bb-e346-40f3-9288-058c31e2573e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.063921 Sep 06 22:48:48.828115 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 348/703] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Sep 6 22:48:48 2022] GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3/os-volume_attachments => generated 371 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:48:48.970580 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b0c10bd4-e1fa-4727-bdd8-11c1b581de4c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:48.971073 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b0c10bd4-e1fa-4727-bdd8-11c1b581de4c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 629fd4f8-24b5-4287-bfe2-ba789169bdb3] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:48.990669 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b0c10bd4-e1fa-4727-bdd8-11c1b581de4c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:48.991659 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b0c10bd4-e1fa-4727-bdd8-11c1b581de4c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:48.995416 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b0c10bd4-e1fa-4727-bdd8-11c1b581de4c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:48.996469 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b0c10bd4-e1fa-4727-bdd8-11c1b581de4c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:48.997037 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b0c10bd4-e1fa-4727-bdd8-11c1b581de4c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:48.997669 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b0c10bd4-e1fa-4727-bdd8-11c1b581de4c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:49.006516 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7d1324ba-c60a-4166-9cea-ba2e498c3cd4 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:49.007132 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7d1324ba-c60a-4166-9cea-ba2e498c3cd4 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:49.033028 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d1324ba-c60a-4166-9cea-ba2e498c3cd4 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:49.033028 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d1324ba-c60a-4166-9cea-ba2e498c3cd4 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:49.033028 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d1324ba-c60a-4166-9cea-ba2e498c3cd4 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:49.033028 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d1324ba-c60a-4166-9cea-ba2e498c3cd4 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:49.033356 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d1324ba-c60a-4166-9cea-ba2e498c3cd4 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:49.033356 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7d1324ba-c60a-4166-9cea-ba2e498c3cd4 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:49.093320 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:48:49.115808 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b0c10bd4-e1fa-4727-bdd8-11c1b581de4c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3/os-volume_attachments/2dc93dc5-63ee-4c00-a5c2-e8ff4087a912" status: 200 len: 194 microversion: 2.1 time: 0.152628 Sep 06 22:48:49.116987 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 356/704] 10.222.0.39 () {58 vars in 1413 bytes} [Tue Sep 6 22:48:48 2022] GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3/os-volume_attachments/2dc93dc5-63ee-4c00-a5c2-e8ff4087a912 => generated 194 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:48:49.140836 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ae7fccb9-3ac6-47fd-ae1b-0899444410bd tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:49.141774 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ae7fccb9-3ac6-47fd-ae1b-0899444410bd tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 629fd4f8-24b5-4287-bfe2-ba789169bdb3] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:49.152011 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ae7fccb9-3ac6-47fd-ae1b-0899444410bd tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:49.152777 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ae7fccb9-3ac6-47fd-ae1b-0899444410bd tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:49.153470 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ae7fccb9-3ac6-47fd-ae1b-0899444410bd tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:49.155926 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ae7fccb9-3ac6-47fd-ae1b-0899444410bd tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:49.156427 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ae7fccb9-3ac6-47fd-ae1b-0899444410bd tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:49.159588 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ae7fccb9-3ac6-47fd-ae1b-0899444410bd tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:49.399096 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.objects.instance [None req-ae7fccb9-3ac6-47fd-ae1b-0899444410bd tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lazy-loading 'services' on Instance uuid 629fd4f8-24b5-4287-bfe2-ba789169bdb3 {{(pid=127087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 22:48:49.464642 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7d1324ba-c60a-4166-9cea-ba2e498c3cd4 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:49.476076 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7d1324ba-c60a-4166-9cea-ba2e498c3cd4 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:49.477850 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7d1324ba-c60a-4166-9cea-ba2e498c3cd4 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:49.479552 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7d1324ba-c60a-4166-9cea-ba2e498c3cd4 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1740 microversion: 2.20 time: 0.477029 Sep 06 22:48:49.480588 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 349/705] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:48:49 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1740 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 22:48:49.549144 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ae7fccb9-3ac6-47fd-ae1b-0899444410bd tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "DELETE /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3/os-volume_attachments/2dc93dc5-63ee-4c00-a5c2-e8ff4087a912" status: 202 len: 0 microversion: 2.1 time: 0.422285 Sep 06 22:48:49.550237 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 357/706] 10.222.0.39 () {58 vars in 1416 bytes} [Tue Sep 6 22:48:49 2022] DELETE /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3/os-volume_attachments/2dc93dc5-63ee-4c00-a5c2-e8ff4087a912 => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 22:48:49.603854 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-4b5b7b13-f4fa-4845-8e66-07345583b02f req-0769ac6e-1a86-44be-920a-21a8b91edc30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7930b2ec-9579-46df-a554-d9b9ba019126", "name": "network-vif-deleted", "tag": "a641f658-6203-4321-afb0-71036d26ddf5"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:48:49.619508 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-4b5b7b13-f4fa-4845-8e66-07345583b02f req-0769ac6e-1a86-44be-920a-21a8b91edc30 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:49.620520 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-4b5b7b13-f4fa-4845-8e66-07345583b02f req-0769ac6e-1a86-44be-920a-21a8b91edc30 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:49.622678 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-4b5b7b13-f4fa-4845-8e66-07345583b02f req-0769ac6e-1a86-44be-920a-21a8b91edc30 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:49.641432 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-4b5b7b13-f4fa-4845-8e66-07345583b02f req-0769ac6e-1a86-44be-920a-21a8b91edc30 service nova] Creating event network-vif-deleted:a641f658-6203-4321-afb0-71036d26ddf5 for instance 7930b2ec-9579-46df-a554-d9b9ba019126 on hv-cinder-85220 Sep 06 22:48:49.649272 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-4b5b7b13-f4fa-4845-8e66-07345583b02f req-0769ac6e-1a86-44be-920a-21a8b91edc30 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167139 Sep 06 22:48:49.650430 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 350/707] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:48:49.723355 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-77f48eaf-f43f-4694-a30d-ceb413909705 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:49.724388 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-77f48eaf-f43f-4694-a30d-ceb413909705 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:49.742436 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-90b963dc-f49f-4e77-a7df-24e7984abb85 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:49.743251 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-77f48eaf-f43f-4694-a30d-ceb413909705 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:49.743796 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-77f48eaf-f43f-4694-a30d-ceb413909705 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:49.744936 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-77f48eaf-f43f-4694-a30d-ceb413909705 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:49.745412 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-90b963dc-f49f-4e77-a7df-24e7984abb85 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:49.745613 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-77f48eaf-f43f-4694-a30d-ceb413909705 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:49.754230 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-90b963dc-f49f-4e77-a7df-24e7984abb85 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:49.755045 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-90b963dc-f49f-4e77-a7df-24e7984abb85 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:49.755936 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-90b963dc-f49f-4e77-a7df-24e7984abb85 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:49.757357 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-90b963dc-f49f-4e77-a7df-24e7984abb85 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:49.758779 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-90b963dc-f49f-4e77-a7df-24e7984abb85 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:49.759307 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-90b963dc-f49f-4e77-a7df-24e7984abb85 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:49.763617 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-77f48eaf-f43f-4694-a30d-ceb413909705 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:49.764171 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-77f48eaf-f43f-4694-a30d-ceb413909705 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:49.809517 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-77f48eaf-f43f-4694-a30d-ceb413909705 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:49.810303 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-77f48eaf-f43f-4694-a30d-ceb413909705 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:49.811480 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-77f48eaf-f43f-4694-a30d-ceb413909705 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:49.812093 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.objects.instance [None req-77f48eaf-f43f-4694-a30d-ceb413909705 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lazy-loading 'fault' on Instance uuid 7930b2ec-9579-46df-a554-d9b9ba019126 {{(pid=127087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 22:48:49.883014 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-77f48eaf-f43f-4694-a30d-ceb413909705 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:49.890908 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-77f48eaf-f43f-4694-a30d-ceb413909705 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126" status: 200 len: 1230 microversion: 2.1 time: 0.172233 Sep 06 22:48:49.891483 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 358/708] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:48:49 2022] GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 => generated 1230 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:48:49.957751 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-90b963dc-f49f-4e77-a7df-24e7984abb85 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:49.968088 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-90b963dc-f49f-4e77-a7df-24e7984abb85 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1569 microversion: 2.1 time: 0.232581 Sep 06 22:48:49.972817 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 351/709] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:48:49 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1569 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:48:50.507082 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-4f85bbad-f554-4922-b967-9a70a5d06c46 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:50.507695 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-4f85bbad-f554-4922-b967-9a70a5d06c46 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:50.511121 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=46 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:48:50.523009 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4f85bbad-f554-4922-b967-9a70a5d06c46 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:50.523503 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4f85bbad-f554-4922-b967-9a70a5d06c46 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:50.524138 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4f85bbad-f554-4922-b967-9a70a5d06c46 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:50.525056 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4f85bbad-f554-4922-b967-9a70a5d06c46 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:50.526518 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4f85bbad-f554-4922-b967-9a70a5d06c46 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:50.527103 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4f85bbad-f554-4922-b967-9a70a5d06c46 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:50.731794 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-4f85bbad-f554-4922-b967-9a70a5d06c46 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:50.742913 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-4f85bbad-f554-4922-b967-9a70a5d06c46 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:50.750623 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-4f85bbad-f554-4922-b967-9a70a5d06c46 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:50.751826 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-4f85bbad-f554-4922-b967-9a70a5d06c46 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1740 microversion: 2.20 time: 0.248841 Sep 06 22:48:50.752380 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 359/710] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:48:50 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1740 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:48:50.812339 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a214c842-e48d-479b-91e5-f80219071de6 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:50.812917 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a214c842-e48d-479b-91e5-f80219071de6 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 629fd4f8-24b5-4287-bfe2-ba789169bdb3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:50.816935 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:48:50.823847 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a214c842-e48d-479b-91e5-f80219071de6 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:50.824568 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a214c842-e48d-479b-91e5-f80219071de6 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:50.833367 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a214c842-e48d-479b-91e5-f80219071de6 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:50.834972 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a214c842-e48d-479b-91e5-f80219071de6 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:50.836561 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a214c842-e48d-479b-91e5-f80219071de6 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:50.837798 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a214c842-e48d-479b-91e5-f80219071de6 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:50.889705 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a214c842-e48d-479b-91e5-f80219071de6 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3/os-volume_attachments/63233d14-6437-4909-9734-5d1c2331e878" status: 200 len: 194 microversion: 2.1 time: 0.081153 Sep 06 22:48:50.896476 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 352/711] 10.222.0.39 () {58 vars in 1413 bytes} [Tue Sep 6 22:48:50 2022] GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3/os-volume_attachments/63233d14-6437-4909-9734-5d1c2331e878 => generated 194 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:48:50.903534 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-854df594-62d5-4d71-9f9a-0fa729523f5e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:50.904641 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-854df594-62d5-4d71-9f9a-0fa729523f5e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 629fd4f8-24b5-4287-bfe2-ba789169bdb3] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:50.918011 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-854df594-62d5-4d71-9f9a-0fa729523f5e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:50.920942 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-854df594-62d5-4d71-9f9a-0fa729523f5e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:50.922327 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0bbc4f50-0c7a-46a8-9624-9d72766ad19a tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:50.922481 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-854df594-62d5-4d71-9f9a-0fa729523f5e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:50.923280 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0bbc4f50-0c7a-46a8-9624-9d72766ad19a tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:50.923691 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-854df594-62d5-4d71-9f9a-0fa729523f5e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:50.924442 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-854df594-62d5-4d71-9f9a-0fa729523f5e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:50.925091 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-854df594-62d5-4d71-9f9a-0fa729523f5e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:50.932795 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0bbc4f50-0c7a-46a8-9624-9d72766ad19a tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:50.934377 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0bbc4f50-0c7a-46a8-9624-9d72766ad19a tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:50.935187 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0bbc4f50-0c7a-46a8-9624-9d72766ad19a tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:50.936400 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0bbc4f50-0c7a-46a8-9624-9d72766ad19a tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:50.937148 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0bbc4f50-0c7a-46a8-9624-9d72766ad19a tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:50.937738 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0bbc4f50-0c7a-46a8-9624-9d72766ad19a tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:50.981274 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0bbc4f50-0c7a-46a8-9624-9d72766ad19a tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:50.982119 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0bbc4f50-0c7a-46a8-9624-9d72766ad19a tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:50.982912 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0bbc4f50-0c7a-46a8-9624-9d72766ad19a tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:50.983725 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-0bbc4f50-0c7a-46a8-9624-9d72766ad19a tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lazy-loading 'fault' on Instance uuid 7930b2ec-9579-46df-a554-d9b9ba019126 {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 22:48:51.032348 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.objects.instance [None req-854df594-62d5-4d71-9f9a-0fa729523f5e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lazy-loading 'services' on Instance uuid 629fd4f8-24b5-4287-bfe2-ba789169bdb3 {{(pid=127087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 22:48:51.044302 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0bbc4f50-0c7a-46a8-9624-9d72766ad19a tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:51.055004 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0bbc4f50-0c7a-46a8-9624-9d72766ad19a tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126" status: 200 len: 1230 microversion: 2.1 time: 0.144666 Sep 06 22:48:51.057566 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 353/712] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:48:50 2022] GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 => generated 1230 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:48:51.063968 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-661f8e24-c1b8-4db2-9596-4a312deba8ec tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:51.064574 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-661f8e24-c1b8-4db2-9596-4a312deba8ec tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:51.074409 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-661f8e24-c1b8-4db2-9596-4a312deba8ec tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:51.075149 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-661f8e24-c1b8-4db2-9596-4a312deba8ec tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:51.075880 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-661f8e24-c1b8-4db2-9596-4a312deba8ec tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:51.078212 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-661f8e24-c1b8-4db2-9596-4a312deba8ec tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:51.078953 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-661f8e24-c1b8-4db2-9596-4a312deba8ec tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:51.079465 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-661f8e24-c1b8-4db2-9596-4a312deba8ec tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:51.196850 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-854df594-62d5-4d71-9f9a-0fa729523f5e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "DELETE /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3/os-volume_attachments/63233d14-6437-4909-9734-5d1c2331e878" status: 202 len: 0 microversion: 2.1 time: 0.299879 Sep 06 22:48:51.198866 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 360/713] 10.222.0.39 () {58 vars in 1416 bytes} [Tue Sep 6 22:48:50 2022] DELETE /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3/os-volume_attachments/63233d14-6437-4909-9734-5d1c2331e878 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 22:48:51.416561 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-661f8e24-c1b8-4db2-9596-4a312deba8ec tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:51.426975 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-661f8e24-c1b8-4db2-9596-4a312deba8ec tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1569 microversion: 2.1 time: 0.368336 Sep 06 22:48:51.427767 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 354/714] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:48:51 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1569 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:48:51.779555 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-bb592407-8c6f-4b7f-a0a9-66289253045a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:51.780264 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-bb592407-8c6f-4b7f-a0a9-66289253045a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:51.790109 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bb592407-8c6f-4b7f-a0a9-66289253045a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:51.791103 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bb592407-8c6f-4b7f-a0a9-66289253045a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:51.791753 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bb592407-8c6f-4b7f-a0a9-66289253045a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:51.792683 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bb592407-8c6f-4b7f-a0a9-66289253045a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:51.793345 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bb592407-8c6f-4b7f-a0a9-66289253045a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:51.794064 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bb592407-8c6f-4b7f-a0a9-66289253045a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:52.009107 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-bb592407-8c6f-4b7f-a0a9-66289253045a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:52.019041 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-bb592407-8c6f-4b7f-a0a9-66289253045a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:52.020708 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-bb592407-8c6f-4b7f-a0a9-66289253045a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:52.022213 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-bb592407-8c6f-4b7f-a0a9-66289253045a tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1740 microversion: 2.20 time: 0.247804 Sep 06 22:48:52.022778 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 361/715] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:48:51 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1740 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:48:52.083805 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4056609a-855a-4017-b097-eca41424ca73 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:52.084560 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4056609a-855a-4017-b097-eca41424ca73 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:52.105242 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4056609a-855a-4017-b097-eca41424ca73 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:52.105242 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4056609a-855a-4017-b097-eca41424ca73 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:52.105242 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4056609a-855a-4017-b097-eca41424ca73 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:52.105242 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4056609a-855a-4017-b097-eca41424ca73 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:52.105633 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4056609a-855a-4017-b097-eca41424ca73 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:52.105633 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4056609a-855a-4017-b097-eca41424ca73 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:52.121401 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-4056609a-855a-4017-b097-eca41424ca73 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] HTTP exception thrown: Instance 7930b2ec-9579-46df-a554-d9b9ba019126 could not be found. Sep 06 22:48:52.126521 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4056609a-855a-4017-b097-eca41424ca73 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Request method failure captured: Sep 06 22:48:52.126521 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 HTTP/1.1 Sep 06 22:48:52.126521 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept: application/json Sep 06 22:48:52.126521 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Sep 06 22:48:52.126521 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Connection: close Sep 06 22:48:52.126521 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Length: 0 Sep 06 22:48:52.126521 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Type: application/json Sep 06 22:48:52.126521 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Host: 10.222.0.39 Sep 06 22:48:52.126521 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Sep 06 22:48:52.126521 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Sep 06 22:48:52.126521 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjF82Ap10uAwga9UaNgI0YSLtD2GAcJ-KBqO8hmQ1SgLUyG-QbzSEQhw0c9i1QLdiHOcbUzu0-LnWV2Xu71fhrgHEbw2fmStUxQtj1ErYFz8ALnAkDeHD9G5TpqDQXZqC_5ma1z-PiT19KGywR8DmLNKlr6dAyW2nNCaDvBk-VdgdKHQk Sep 06 22:48:52.126521 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Sep 06 22:48:52.126521 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Sep 06 22:48:52.126521 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Sep 06 22:48:52.126521 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Sep 06 22:48:52.126521 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Sep 06 22:48:52.126521 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Sep 06 22:48:52.126521 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Id: cc47231427ec4337833eb5d733b211bc Sep 06 22:48:52.126521 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-TestVolumeBootPattern-911177040 Sep 06 22:48:52.126521 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Role: reader,member Sep 06 22:48:52.126521 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Sep 06 22:48:52.128100 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cc47231427ec4337833eb5d733b211bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cc47231427ec4337833eb5d733b211bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc47231427ec4337833eb5d733b211bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc47231427ec4337833eb5d733b211bc"}]}] Sep 06 22:48:52.128100 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-TestVolumeBootPattern-911177040 Sep 06 22:48:52.128100 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Id: cc47231427ec4337833eb5d733b211bc Sep 06 22:48:52.128100 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-TestVolumeBootPattern-911177040 Sep 06 22:48:52.128100 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User: tempest-TestVolumeBootPattern-911177040-project Sep 06 22:48:52.128100 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Sep 06 22:48:52.128100 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Sep 06 22:48:52.128100 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Id: 29018ec15cc147d3919d9047569a4c68 Sep 06 22:48:52.128100 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-TestVolumeBootPattern-911177040-project Sep 06 22:48:52.128100 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: method: > Sep 06 22:48:52.128100 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: exception: Instance 7930b2ec-9579-46df-a554-d9b9ba019126 could not be found. Sep 06 22:48:52.128100 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: action_args: {'id': '7930b2ec-9579-46df-a554-d9b9ba019126'} Sep 06 22:48:52.129176 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:48:52.129176 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:48:52.129176 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:48:52.129176 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:48:52.129176 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:48:52.129176 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:48:52.129176 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:48:52.129176 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:48:52.129176 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:48:52.129176 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:48:52.129176 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7930b2ec-9579-46df-a554-d9b9ba019126 could not be found. Sep 06 22:48:52.129176 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:48:52.129176 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:48:52.129176 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:48:52.129176 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:48:52.129176 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:48:52.129176 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:48:52.129176 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:48:52.129176 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:48:52.129176 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:48:52.130661 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:48:52.130661 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 22:48:52.130661 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 22:48:52.130661 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:48:52.130661 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:48:52.130661 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:48:52.130661 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:48:52.130661 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7930b2ec-9579-46df-a554-d9b9ba019126 could not be found. Sep 06 22:48:52.130661 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:48:52.130661 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:48:52.130661 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:48:52.130661 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:48:52.130661 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:48:52.130661 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:48:52.130661 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:48:52.130661 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:48:52.130661 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7930b2ec-9579-46df-a554-d9b9ba019126 could not be found. Sep 06 22:48:52.130661 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:48:52.132750 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4056609a-855a-4017-b097-eca41424ca73 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Returning 404 to user: Instance 7930b2ec-9579-46df-a554-d9b9ba019126 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:48:52.133892 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4056609a-855a-4017-b097-eca41424ca73 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126" status: 404 len: 111 microversion: 2.1 time: 0.057275 Sep 06 22:48:52.135671 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 355/716] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:48:52 2022] GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 22:48:52.310901 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f64699d1-b601-401d-a849-278c8c5b46d2 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-197774567", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1102918603", "security_groups": [{"name": "tempest-secgroup-smoke-1541823835"}], "block_device_mapping_v2": [{"uuid": "0c6219f8-9a89-48a2-8eb0-3d7efd53b5e3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "58d448a5-1081-4b4c-a11f-e7854551fb17"}]}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:48:52.458364 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-69c268c4-6878-42cf-9d3f-36dec712bdd2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:52.459714 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-69c268c4-6878-42cf-9d3f-36dec712bdd2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:52.473045 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69c268c4-6878-42cf-9d3f-36dec712bdd2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:52.474229 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69c268c4-6878-42cf-9d3f-36dec712bdd2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:52.474862 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69c268c4-6878-42cf-9d3f-36dec712bdd2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:52.475901 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69c268c4-6878-42cf-9d3f-36dec712bdd2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:52.476677 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69c268c4-6878-42cf-9d3f-36dec712bdd2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:52.477524 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69c268c4-6878-42cf-9d3f-36dec712bdd2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:52.601179 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.network.neutron [None req-f64699d1-b601-401d-a849-278c8c5b46d2 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] validate_networks() for [('58d448a5-1081-4b4c-a11f-e7854551fb17', None, None, None, None, None)] {{(pid=127087) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 22:48:52.834597 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-69c268c4-6878-42cf-9d3f-36dec712bdd2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:52.846035 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-69c268c4-6878-42cf-9d3f-36dec712bdd2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1569 microversion: 2.1 time: 0.394050 Sep 06 22:48:52.855188 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 356/717] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:48:52 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1569 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:48:52.873700 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-71b45746-0eea-4810-b363-2cdb5db13d22 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:52.876212 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-71b45746-0eea-4810-b363-2cdb5db13d22 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 629fd4f8-24b5-4287-bfe2-ba789169bdb3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:52.892559 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-71b45746-0eea-4810-b363-2cdb5db13d22 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:52.893734 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-71b45746-0eea-4810-b363-2cdb5db13d22 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:52.894446 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-71b45746-0eea-4810-b363-2cdb5db13d22 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:52.895481 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-71b45746-0eea-4810-b363-2cdb5db13d22 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:52.896166 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-71b45746-0eea-4810-b363-2cdb5db13d22 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:52.896981 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-71b45746-0eea-4810-b363-2cdb5db13d22 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:52.951620 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-71b45746-0eea-4810-b363-2cdb5db13d22 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.096743 Sep 06 22:48:52.952492 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 357/718] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Sep 6 22:48:52 2022] GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3/os-volume_attachments => generated 25 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 22:48:53.050983 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a78e0ce6-f152-4568-8986-e8bd49d1b558 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:53.051590 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a78e0ce6-f152-4568-8986-e8bd49d1b558 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:53.058059 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a78e0ce6-f152-4568-8986-e8bd49d1b558 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:53.058540 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a78e0ce6-f152-4568-8986-e8bd49d1b558 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:53.058972 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a78e0ce6-f152-4568-8986-e8bd49d1b558 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:53.059666 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a78e0ce6-f152-4568-8986-e8bd49d1b558 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:53.083718 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a78e0ce6-f152-4568-8986-e8bd49d1b558 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:53.085302 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a78e0ce6-f152-4568-8986-e8bd49d1b558 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:53.522300 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-f64699d1-b601-401d-a849-278c8c5b46d2 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Flavor limits 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 22:48:53.523348 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-f64699d1-b601-401d-a849-278c8c5b46d2 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Image limits 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 22:48:53.524154 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-f64699d1-b601-401d-a849-278c8c5b46d2 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Flavor pref 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 22:48:53.525503 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-f64699d1-b601-401d-a849-278c8c5b46d2 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Image pref 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 22:48:53.532941 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-f64699d1-b601-401d-a849-278c8c5b46d2 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 22:48:53.538605 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a78e0ce6-f152-4568-8986-e8bd49d1b558 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:53.553225 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a78e0ce6-f152-4568-8986-e8bd49d1b558 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:53.554933 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a78e0ce6-f152-4568-8986-e8bd49d1b558 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:53.558376 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a78e0ce6-f152-4568-8986-e8bd49d1b558 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1740 microversion: 2.20 time: 0.511536 Sep 06 22:48:53.562277 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 358/719] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:48:53 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1740 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 22:48:53.570558 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9cb43a99-cfc5-4e82-8f66-e26f4b9d263c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:53.578719 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9cb43a99-cfc5-4e82-8f66-e26f4b9d263c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 629fd4f8-24b5-4287-bfe2-ba789169bdb3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:53.593290 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9cb43a99-cfc5-4e82-8f66-e26f4b9d263c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:53.594094 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9cb43a99-cfc5-4e82-8f66-e26f4b9d263c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:53.596916 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9cb43a99-cfc5-4e82-8f66-e26f4b9d263c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:53.598030 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9cb43a99-cfc5-4e82-8f66-e26f4b9d263c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:53.602743 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9cb43a99-cfc5-4e82-8f66-e26f4b9d263c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:53.603532 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9cb43a99-cfc5-4e82-8f66-e26f4b9d263c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:53.607295 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f64699d1-b601-401d-a849-278c8c5b46d2 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:53.608145 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f64699d1-b601-401d-a849-278c8c5b46d2 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:53.610492 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f64699d1-b601-401d-a849-278c8c5b46d2 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:53.611993 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f64699d1-b601-401d-a849-278c8c5b46d2 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:53.621375 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f64699d1-b601-401d-a849-278c8c5b46d2 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:53.622111 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f64699d1-b601-401d-a849-278c8c5b46d2 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:53.696539 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9cb43a99-cfc5-4e82-8f66-e26f4b9d263c tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.132872 Sep 06 22:48:53.709136 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 359/720] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Sep 6 22:48:53 2022] GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3/os-volume_attachments => generated 25 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 22:48:53.726175 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-f64699d1-b601-401d-a849-278c8c5b46d2 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Getting quotas for project cc47231427ec4337833eb5d733b211bc. Resources: {'instances', 'ram', 'cores'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 22:48:53.737327 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-f64699d1-b601-401d-a849-278c8c5b46d2 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Getting quotas for user 29018ec15cc147d3919d9047569a4c68 and project cc47231427ec4337833eb5d733b211bc. Resources: {'instances', 'ram', 'cores'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 22:48:53.807226 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-3c596617-f886-4fe7-b283-e3145169a4b7 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:53.807584 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3c596617-f886-4fe7-b283-e3145169a4b7 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 629fd4f8-24b5-4287-bfe2-ba789169bdb3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:53.823401 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3c596617-f886-4fe7-b283-e3145169a4b7 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:53.823908 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3c596617-f886-4fe7-b283-e3145169a4b7 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:53.824353 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3c596617-f886-4fe7-b283-e3145169a4b7 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:53.825116 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3c596617-f886-4fe7-b283-e3145169a4b7 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:53.825572 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3c596617-f886-4fe7-b283-e3145169a4b7 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:53.825994 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-3c596617-f886-4fe7-b283-e3145169a4b7 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:53.897398 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-3c596617-f886-4fe7-b283-e3145169a4b7 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 629fd4f8-24b5-4287-bfe2-ba789169bdb3] Going to try to terminate instance {{(pid=127088) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 22:48:53.905723 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-f64699d1-b601-401d-a849-278c8c5b46d2 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Going to run 1 instances... {{(pid=127087) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 22:48:53.908245 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-f64699d1-b601-401d-a849-278c8c5b46d2 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 5acd0d35-4bad-4c55-853d-767fec050879] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0c6219f8-9a89-48a2-8eb0-3d7efd53b5e3',volume_size=None,volume_type=None)] {{(pid=127087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 22:48:54.105605 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-3c596617-f886-4fe7-b283-e3145169a4b7 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "DELETE /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3" status: 204 len: 0 microversion: 2.1 time: 0.304132 Sep 06 22:48:54.108735 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 360/721] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Sep 6 22:48:53 2022] DELETE /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 22:48:54.123080 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e5eaca14-f1e1-4dcf-8fd1-310bd6721e47 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:54.125288 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e5eaca14-f1e1-4dcf-8fd1-310bd6721e47 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:54.132926 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e5eaca14-f1e1-4dcf-8fd1-310bd6721e47 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:54.133949 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e5eaca14-f1e1-4dcf-8fd1-310bd6721e47 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:54.134780 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e5eaca14-f1e1-4dcf-8fd1-310bd6721e47 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:54.135927 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e5eaca14-f1e1-4dcf-8fd1-310bd6721e47 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:54.136733 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e5eaca14-f1e1-4dcf-8fd1-310bd6721e47 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:54.137504 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e5eaca14-f1e1-4dcf-8fd1-310bd6721e47 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:54.162002 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:48:54.167271 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-f64699d1-b601-401d-a849-278c8c5b46d2 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.861886 Sep 06 22:48:54.168548 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 362/722] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Sep 6 22:48:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 1865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 22:48:54.177547 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b0d7151a-b8ea-41cc-8a9c-db9a2f7fdde1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:54.179503 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b0d7151a-b8ea-41cc-8a9c-db9a2f7fdde1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 629fd4f8-24b5-4287-bfe2-ba789169bdb3] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:54.189714 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b0d7151a-b8ea-41cc-8a9c-db9a2f7fdde1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:54.191094 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b0d7151a-b8ea-41cc-8a9c-db9a2f7fdde1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:54.192202 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b0d7151a-b8ea-41cc-8a9c-db9a2f7fdde1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:54.194915 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b0d7151a-b8ea-41cc-8a9c-db9a2f7fdde1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:54.198575 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b0d7151a-b8ea-41cc-8a9c-db9a2f7fdde1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:54.199441 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b0d7151a-b8ea-41cc-8a9c-db9a2f7fdde1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:54.405237 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e5eaca14-f1e1-4dcf-8fd1-310bd6721e47 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:54.413566 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e5eaca14-f1e1-4dcf-8fd1-310bd6721e47 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1569 microversion: 2.1 time: 0.301828 Sep 06 22:48:54.421162 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 361/723] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:48:54 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1569 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:48:54.426120 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4991f48a-07c7-4bfa-960e-8c6d6b0c6487 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:54.426734 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4991f48a-07c7-4bfa-960e-8c6d6b0c6487 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 5acd0d35-4bad-4c55-853d-767fec050879] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:54.465913 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b0d7151a-b8ea-41cc-8a9c-db9a2f7fdde1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:54.475597 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b0d7151a-b8ea-41cc-8a9c-db9a2f7fdde1 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3" status: 200 len: 1669 microversion: 2.1 time: 0.304977 Sep 06 22:48:54.476567 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 363/724] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:48:54 2022] GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3 => generated 1669 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:48:54.532412 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4991f48a-07c7-4bfa-960e-8c6d6b0c6487 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:54.542495 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4991f48a-07c7-4bfa-960e-8c6d6b0c6487 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879" status: 200 len: 1094 microversion: 2.1 time: 0.120178 Sep 06 22:48:54.543076 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 362/725] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:48:54 2022] GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879 => generated 1094 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:48:54.595890 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-437bb6c0-c1a5-4136-8bfa-d39f0603181f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:54.596422 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-437bb6c0-c1a5-4136-8bfa-d39f0603181f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:54.626611 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-437bb6c0-c1a5-4136-8bfa-d39f0603181f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:54.628697 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-437bb6c0-c1a5-4136-8bfa-d39f0603181f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:54.629312 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-437bb6c0-c1a5-4136-8bfa-d39f0603181f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:54.633841 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-437bb6c0-c1a5-4136-8bfa-d39f0603181f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:54.634793 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-437bb6c0-c1a5-4136-8bfa-d39f0603181f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:54.638936 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-437bb6c0-c1a5-4136-8bfa-d39f0603181f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:54.855304 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-437bb6c0-c1a5-4136-8bfa-d39f0603181f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:54.870132 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-437bb6c0-c1a5-4136-8bfa-d39f0603181f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:54.871602 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-437bb6c0-c1a5-4136-8bfa-d39f0603181f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:54.872986 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-437bb6c0-c1a5-4136-8bfa-d39f0603181f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1740 microversion: 2.20 time: 0.290255 Sep 06 22:48:54.874021 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 364/726] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:48:54 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1740 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:48:55.439999 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-993eee55-bb67-4820-b021-656c4ac1d44f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:55.441227 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-993eee55-bb67-4820-b021-656c4ac1d44f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:55.448430 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-993eee55-bb67-4820-b021-656c4ac1d44f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:55.448940 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-993eee55-bb67-4820-b021-656c4ac1d44f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:55.449364 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-993eee55-bb67-4820-b021-656c4ac1d44f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:55.450280 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-993eee55-bb67-4820-b021-656c4ac1d44f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:55.450947 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-993eee55-bb67-4820-b021-656c4ac1d44f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:55.451434 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-993eee55-bb67-4820-b021-656c4ac1d44f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:55.505079 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d8ab8374-0921-432d-a48f-9ab05043632b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:55.505720 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-d8ab8374-0921-432d-a48f-9ab05043632b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 629fd4f8-24b5-4287-bfe2-ba789169bdb3] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:55.514722 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d8ab8374-0921-432d-a48f-9ab05043632b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:55.515211 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d8ab8374-0921-432d-a48f-9ab05043632b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:55.515641 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d8ab8374-0921-432d-a48f-9ab05043632b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:55.519450 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d8ab8374-0921-432d-a48f-9ab05043632b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:55.520176 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d8ab8374-0921-432d-a48f-9ab05043632b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:55.520836 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d8ab8374-0921-432d-a48f-9ab05043632b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:55.702093 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-993eee55-bb67-4820-b021-656c4ac1d44f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:55.714601 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-993eee55-bb67-4820-b021-656c4ac1d44f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1569 microversion: 2.1 time: 0.278279 Sep 06 22:48:55.729397 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 363/727] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:48:55 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1569 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:48:55.737186 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-479ac51c-842d-4141-95bb-dc2395d78d29 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:55.738199 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-479ac51c-842d-4141-95bb-dc2395d78d29 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 5acd0d35-4bad-4c55-853d-767fec050879] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:55.745969 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-479ac51c-842d-4141-95bb-dc2395d78d29 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:55.746580 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-479ac51c-842d-4141-95bb-dc2395d78d29 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:55.747283 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-479ac51c-842d-4141-95bb-dc2395d78d29 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:55.748255 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-479ac51c-842d-4141-95bb-dc2395d78d29 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:55.749976 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-479ac51c-842d-4141-95bb-dc2395d78d29 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:55.750639 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-479ac51c-842d-4141-95bb-dc2395d78d29 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:55.785699 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-d8ab8374-0921-432d-a48f-9ab05043632b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:55.805193 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d8ab8374-0921-432d-a48f-9ab05043632b tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3" status: 200 len: 1669 microversion: 2.1 time: 0.303886 Sep 06 22:48:55.806084 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 365/728] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:48:55 2022] GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3 => generated 1669 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:48:55.864184 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-479ac51c-842d-4141-95bb-dc2395d78d29 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:55.903316 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-479ac51c-842d-4141-95bb-dc2395d78d29 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879" status: 200 len: 1136 microversion: 2.1 time: 0.172308 Sep 06 22:48:55.903845 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-33c9f10f-5405-4451-9d0d-9025ab154e4f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:55.904810 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-33c9f10f-5405-4451-9d0d-9025ab154e4f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:55.917750 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 364/729] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:48:55 2022] GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879 => generated 1136 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:48:55.924473 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-33c9f10f-5405-4451-9d0d-9025ab154e4f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:55.925304 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-33c9f10f-5405-4451-9d0d-9025ab154e4f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:55.925939 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-33c9f10f-5405-4451-9d0d-9025ab154e4f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:55.926840 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-33c9f10f-5405-4451-9d0d-9025ab154e4f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:55.928132 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-33c9f10f-5405-4451-9d0d-9025ab154e4f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:55.928885 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-33c9f10f-5405-4451-9d0d-9025ab154e4f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:55.957617 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a33e63ff-cd9f-473c-8f26-0fe46b2bd4f6 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-546375509", "imageRef": "93326d5e-4826-431e-9ad1-6ee2d44e48d9", "flavorRef": "452", "networks": [{"uuid": "bb111489-5654-49b6-a948-e938c971cdc9"}]}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:48:56.029345 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.network.neutron [None req-a33e63ff-cd9f-473c-8f26-0fe46b2bd4f6 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] validate_networks() for [('bb111489-5654-49b6-a948-e938c971cdc9', None, None, None, None, None)] {{(pid=127088) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 22:48:56.390363 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-33c9f10f-5405-4451-9d0d-9025ab154e4f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:56.402396 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-33c9f10f-5405-4451-9d0d-9025ab154e4f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:56.404309 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-33c9f10f-5405-4451-9d0d-9025ab154e4f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:56.405895 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-33c9f10f-5405-4451-9d0d-9025ab154e4f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1740 microversion: 2.20 time: 0.510388 Sep 06 22:48:56.421168 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 366/730] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:48:55 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1740 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:48:56.743357 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e890a64f-3c83-4733-b110-4eb6055cabf2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:56.744612 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e890a64f-3c83-4733-b110-4eb6055cabf2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:56.758299 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e890a64f-3c83-4733-b110-4eb6055cabf2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:56.759074 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e890a64f-3c83-4733-b110-4eb6055cabf2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:56.760188 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e890a64f-3c83-4733-b110-4eb6055cabf2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:56.761805 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e890a64f-3c83-4733-b110-4eb6055cabf2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:56.762422 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e890a64f-3c83-4733-b110-4eb6055cabf2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:56.763245 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e890a64f-3c83-4733-b110-4eb6055cabf2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:57.561207 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e890a64f-3c83-4733-b110-4eb6055cabf2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:57.575315 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e890a64f-3c83-4733-b110-4eb6055cabf2 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1569 microversion: 2.1 time: 0.835965 Sep 06 22:48:57.593799 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 367/731] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:48:56 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1569 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:48:57.595999 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-aa265dd3-d21f-4212-ae0b-8065ac7cc965 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:57.596870 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-aa265dd3-d21f-4212-ae0b-8065ac7cc965 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 629fd4f8-24b5-4287-bfe2-ba789169bdb3] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:57.610568 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-aa265dd3-d21f-4212-ae0b-8065ac7cc965 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:57.611344 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-aa265dd3-d21f-4212-ae0b-8065ac7cc965 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:57.611924 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-aa265dd3-d21f-4212-ae0b-8065ac7cc965 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:57.612792 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-aa265dd3-d21f-4212-ae0b-8065ac7cc965 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:57.613390 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-aa265dd3-d21f-4212-ae0b-8065ac7cc965 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:57.614017 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-aa265dd3-d21f-4212-ae0b-8065ac7cc965 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:57.632012 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-a33e63ff-cd9f-473c-8f26-0fe46b2bd4f6 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Flavor limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 22:48:57.633211 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-a33e63ff-cd9f-473c-8f26-0fe46b2bd4f6 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Image limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 22:48:57.633892 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-a33e63ff-cd9f-473c-8f26-0fe46b2bd4f6 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Flavor pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 22:48:57.635104 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-a33e63ff-cd9f-473c-8f26-0fe46b2bd4f6 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Image pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 22:48:57.635848 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-a33e63ff-cd9f-473c-8f26-0fe46b2bd4f6 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 22:48:57.649569 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a33e63ff-cd9f-473c-8f26-0fe46b2bd4f6 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:57.651693 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a33e63ff-cd9f-473c-8f26-0fe46b2bd4f6 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:57.652329 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a33e63ff-cd9f-473c-8f26-0fe46b2bd4f6 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:57.653405 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a33e63ff-cd9f-473c-8f26-0fe46b2bd4f6 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:57.654076 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a33e63ff-cd9f-473c-8f26-0fe46b2bd4f6 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:57.654649 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a33e63ff-cd9f-473c-8f26-0fe46b2bd4f6 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:57.683596 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-a33e63ff-cd9f-473c-8f26-0fe46b2bd4f6 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Getting quotas for project 9b3e57c72cec4c128a09749da5a90a5d. Resources: {'instances', 'ram', 'cores'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 22:48:57.688469 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-a33e63ff-cd9f-473c-8f26-0fe46b2bd4f6 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Getting quotas for user e5593dc049144447859a48e458717295 and project 9b3e57c72cec4c128a09749da5a90a5d. Resources: {'instances', 'ram', 'cores'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 22:48:57.703267 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a33e63ff-cd9f-473c-8f26-0fe46b2bd4f6 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Going to run 1 instances... {{(pid=127088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 22:48:57.706575 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a33e63ff-cd9f-473c-8f26-0fe46b2bd4f6 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] [instance: 9e1de8ed-ee4e-40d3-9f22-3560b08031b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='93326d5e-4826-431e-9ad1-6ee2d44e48d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 22:48:57.760539 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a33e63ff-cd9f-473c-8f26-0fe46b2bd4f6 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.806892 Sep 06 22:48:57.762035 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 365/732] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Sep 6 22:48:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 22:48:57.773308 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0cf9e636-71bf-4b76-b31a-d2eea40d4ff5 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:57.774207 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0cf9e636-71bf-4b76-b31a-d2eea40d4ff5 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 5acd0d35-4bad-4c55-853d-767fec050879] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:57.790767 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0cf9e636-71bf-4b76-b31a-d2eea40d4ff5 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:57.793046 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0cf9e636-71bf-4b76-b31a-d2eea40d4ff5 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:57.793644 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0cf9e636-71bf-4b76-b31a-d2eea40d4ff5 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:57.794822 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0cf9e636-71bf-4b76-b31a-d2eea40d4ff5 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:57.796552 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0cf9e636-71bf-4b76-b31a-d2eea40d4ff5 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:57.797348 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0cf9e636-71bf-4b76-b31a-d2eea40d4ff5 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:58.008898 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0cf9e636-71bf-4b76-b31a-d2eea40d4ff5 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:58.022186 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0cf9e636-71bf-4b76-b31a-d2eea40d4ff5 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879" status: 200 len: 1198 microversion: 2.1 time: 0.258790 Sep 06 22:48:58.038545 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 366/733] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:48:57 2022] GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879 => generated 1198 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:48:58.047160 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2c951b41-b98c-4e1b-9381-ad5958715894 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:58.048610 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2c951b41-b98c-4e1b-9381-ad5958715894 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:58.057477 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2c951b41-b98c-4e1b-9381-ad5958715894 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:58.058536 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2c951b41-b98c-4e1b-9381-ad5958715894 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:58.059047 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2c951b41-b98c-4e1b-9381-ad5958715894 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:58.059768 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2c951b41-b98c-4e1b-9381-ad5958715894 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:58.060220 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2c951b41-b98c-4e1b-9381-ad5958715894 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:58.060643 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2c951b41-b98c-4e1b-9381-ad5958715894 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:58.096144 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-aa265dd3-d21f-4212-ae0b-8065ac7cc965 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:58.110146 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-aa265dd3-d21f-4212-ae0b-8065ac7cc965 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3" status: 200 len: 1669 microversion: 2.1 time: 0.525751 Sep 06 22:48:58.111109 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 368/734] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:48:57 2022] GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3 => generated 1669 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:48:58.125579 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-580f1592-5e12-4ddf-b8b7-ad6afcb7c9eb tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:58.126851 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-580f1592-5e12-4ddf-b8b7-ad6afcb7c9eb tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] [instance: 9e1de8ed-ee4e-40d3-9f22-3560b08031b4] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:58.327952 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-580f1592-5e12-4ddf-b8b7-ad6afcb7c9eb tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5593dc049144447859a48e458717295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3e57c72cec4c128a09749da5a90a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:58.336331 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-580f1592-5e12-4ddf-b8b7-ad6afcb7c9eb tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] 10.222.0.39 "GET /compute/v2.1/servers/9e1de8ed-ee4e-40d3-9f22-3560b08031b4" status: 200 len: 1213 microversion: 2.1 time: 0.223825 Sep 06 22:48:58.339435 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 369/735] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:48:58 2022] GET /compute/v2.1/servers/9e1de8ed-ee4e-40d3-9f22-3560b08031b4 => generated 1213 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:48:58.606573 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-58bf8d63-a66f-465d-bf02-e9c0b1efba8f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:58.607203 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-58bf8d63-a66f-465d-bf02-e9c0b1efba8f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:58.619536 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-58bf8d63-a66f-465d-bf02-e9c0b1efba8f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:58.620164 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-58bf8d63-a66f-465d-bf02-e9c0b1efba8f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:58.620837 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-58bf8d63-a66f-465d-bf02-e9c0b1efba8f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:58.621733 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-58bf8d63-a66f-465d-bf02-e9c0b1efba8f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:58.622343 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-58bf8d63-a66f-465d-bf02-e9c0b1efba8f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:58.622923 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-58bf8d63-a66f-465d-bf02-e9c0b1efba8f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:58.685387 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2c951b41-b98c-4e1b-9381-ad5958715894 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:58.703981 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2c951b41-b98c-4e1b-9381-ad5958715894 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:58.705542 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2c951b41-b98c-4e1b-9381-ad5958715894 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:58.706867 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2c951b41-b98c-4e1b-9381-ad5958715894 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1740 microversion: 2.20 time: 0.667147 Sep 06 22:48:58.707430 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 367/736] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:48:58 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1740 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:48:59.050167 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4a0ab77d-592c-4a18-8329-ae662edb87a6 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:59.051043 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4a0ab77d-592c-4a18-8329-ae662edb87a6 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 5acd0d35-4bad-4c55-853d-767fec050879] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:59.059625 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a0ab77d-592c-4a18-8329-ae662edb87a6 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:59.060725 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a0ab77d-592c-4a18-8329-ae662edb87a6 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:59.063999 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a0ab77d-592c-4a18-8329-ae662edb87a6 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:59.064717 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a0ab77d-592c-4a18-8329-ae662edb87a6 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:59.065748 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a0ab77d-592c-4a18-8329-ae662edb87a6 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:59.067630 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4a0ab77d-592c-4a18-8329-ae662edb87a6 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:59.166591 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-58bf8d63-a66f-465d-bf02-e9c0b1efba8f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:59.176681 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-58bf8d63-a66f-465d-bf02-e9c0b1efba8f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1569 microversion: 2.1 time: 0.574106 Sep 06 22:48:59.193759 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 370/737] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:48:58 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1569 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:48:59.205331 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d92653d9-41f8-4fd1-bcdd-d54b9038900e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:59.209618 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-d92653d9-41f8-4fd1-bcdd-d54b9038900e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 629fd4f8-24b5-4287-bfe2-ba789169bdb3] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:59.222336 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d92653d9-41f8-4fd1-bcdd-d54b9038900e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:59.228513 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d92653d9-41f8-4fd1-bcdd-d54b9038900e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:59.229550 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d92653d9-41f8-4fd1-bcdd-d54b9038900e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:59.230537 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d92653d9-41f8-4fd1-bcdd-d54b9038900e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:59.231400 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d92653d9-41f8-4fd1-bcdd-d54b9038900e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:59.232321 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d92653d9-41f8-4fd1-bcdd-d54b9038900e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:59.236830 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4a0ab77d-592c-4a18-8329-ae662edb87a6 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:59.251762 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4a0ab77d-592c-4a18-8329-ae662edb87a6 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879" status: 200 len: 1198 microversion: 2.1 time: 0.201743 Sep 06 22:48:59.252409 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 368/738] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:48:59 2022] GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879 => generated 1198 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:48:59.362035 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-eb08b3da-56e7-4d03-a2be-fb3e24a60d78 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:59.362636 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-eb08b3da-56e7-4d03-a2be-fb3e24a60d78 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] [instance: 9e1de8ed-ee4e-40d3-9f22-3560b08031b4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:59.373811 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eb08b3da-56e7-4d03-a2be-fb3e24a60d78 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:59.380224 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eb08b3da-56e7-4d03-a2be-fb3e24a60d78 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:59.385109 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eb08b3da-56e7-4d03-a2be-fb3e24a60d78 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:59.386130 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eb08b3da-56e7-4d03-a2be-fb3e24a60d78 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:59.386763 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eb08b3da-56e7-4d03-a2be-fb3e24a60d78 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:59.387565 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-eb08b3da-56e7-4d03-a2be-fb3e24a60d78 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:59.586817 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-d92653d9-41f8-4fd1-bcdd-d54b9038900e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dd9f0bff3044d7db561dff21ac0e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817010ab38864d8aafb61140eb176da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:59.637233 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d92653d9-41f8-4fd1-bcdd-d54b9038900e tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3" status: 200 len: 1602 microversion: 2.1 time: 0.434949 Sep 06 22:48:59.639456 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 371/739] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:48:59 2022] GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3 => generated 1602 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:48:59.665676 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-89eeee4a-3425-45a2-83a4-62402c884703 req-8dff165d-c657-431b-b2ba-45d7388b0c7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "629fd4f8-24b5-4287-bfe2-ba789169bdb3", "name": "network-vif-deleted", "tag": "f495fe0d-6277-4e7f-8ade-646a2dd3193c"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:48:59.695827 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-89eeee4a-3425-45a2-83a4-62402c884703 req-8dff165d-c657-431b-b2ba-45d7388b0c7a service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:59.696409 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-89eeee4a-3425-45a2-83a4-62402c884703 req-8dff165d-c657-431b-b2ba-45d7388b0c7a service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:59.697797 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-89eeee4a-3425-45a2-83a4-62402c884703 req-8dff165d-c657-431b-b2ba-45d7388b0c7a service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:59.736039 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-89eeee4a-3425-45a2-83a4-62402c884703 req-8dff165d-c657-431b-b2ba-45d7388b0c7a service nova] Creating event network-vif-deleted:f495fe0d-6277-4e7f-8ade-646a2dd3193c for instance 629fd4f8-24b5-4287-bfe2-ba789169bdb3 on hv-cinder-85220 Sep 06 22:48:59.793648 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-89eeee4a-3425-45a2-83a4-62402c884703 req-8dff165d-c657-431b-b2ba-45d7388b0c7a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151721 Sep 06 22:48:59.794431 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 372/740] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:48:59.799860 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-5e23ec2d-4fee-407b-a129-e693a6f317d5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:48:59.800858 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-5e23ec2d-4fee-407b-a129-e693a6f317d5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:48:59.808328 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e23ec2d-4fee-407b-a129-e693a6f317d5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:59.809195 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e23ec2d-4fee-407b-a129-e693a6f317d5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:59.809857 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e23ec2d-4fee-407b-a129-e693a6f317d5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:59.810665 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e23ec2d-4fee-407b-a129-e693a6f317d5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:48:59.811347 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e23ec2d-4fee-407b-a129-e693a6f317d5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:48:59.811978 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e23ec2d-4fee-407b-a129-e693a6f317d5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:48:59.825197 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-eb08b3da-56e7-4d03-a2be-fb3e24a60d78 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5593dc049144447859a48e458717295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3e57c72cec4c128a09749da5a90a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:48:59.841233 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-eb08b3da-56e7-4d03-a2be-fb3e24a60d78 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] 10.222.0.39 "GET /compute/v2.1/servers/9e1de8ed-ee4e-40d3-9f22-3560b08031b4" status: 200 len: 1283 microversion: 2.1 time: 0.483220 Sep 06 22:48:59.847309 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 369/741] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:48:59 2022] GET /compute/v2.1/servers/9e1de8ed-ee4e-40d3-9f22-3560b08031b4 => generated 1283 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:00.204350 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-57e808f0-dc4b-4392-bb9e-a1eba33cb1df tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:00.205630 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-57e808f0-dc4b-4392-bb9e-a1eba33cb1df tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:00.222595 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-57e808f0-dc4b-4392-bb9e-a1eba33cb1df tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:00.223100 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-57e808f0-dc4b-4392-bb9e-a1eba33cb1df tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:00.223535 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-57e808f0-dc4b-4392-bb9e-a1eba33cb1df tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:00.224248 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-57e808f0-dc4b-4392-bb9e-a1eba33cb1df tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:00.224693 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-57e808f0-dc4b-4392-bb9e-a1eba33cb1df tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:00.241553 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-57e808f0-dc4b-4392-bb9e-a1eba33cb1df tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:00.424423 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-5e23ec2d-4fee-407b-a129-e693a6f317d5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:00.427996 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:00.446318 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-5e23ec2d-4fee-407b-a129-e693a6f317d5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:00.448051 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-5e23ec2d-4fee-407b-a129-e693a6f317d5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:00.449277 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-5e23ec2d-4fee-407b-a129-e693a6f317d5 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1740 microversion: 2.20 time: 0.653668 Sep 06 22:49:00.457209 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 373/742] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:48:59 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1740 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:49:00.468519 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-c9e3a070-4de7-4fc6-a955-6a8070ad3beb tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:00.473271 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-c9e3a070-4de7-4fc6-a955-6a8070ad3beb tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 5acd0d35-4bad-4c55-853d-767fec050879] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:00.487248 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c9e3a070-4de7-4fc6-a955-6a8070ad3beb tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:00.491307 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c9e3a070-4de7-4fc6-a955-6a8070ad3beb tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:00.491929 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c9e3a070-4de7-4fc6-a955-6a8070ad3beb tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:00.495884 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c9e3a070-4de7-4fc6-a955-6a8070ad3beb tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:00.501433 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c9e3a070-4de7-4fc6-a955-6a8070ad3beb tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:00.502163 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c9e3a070-4de7-4fc6-a955-6a8070ad3beb tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:00.959173 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-57e808f0-dc4b-4392-bb9e-a1eba33cb1df tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:00.968478 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-57e808f0-dc4b-4392-bb9e-a1eba33cb1df tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1569 microversion: 2.1 time: 0.768369 Sep 06 22:49:00.987107 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 370/743] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:00 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1569 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:49:00.995167 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-92d452ce-7ef5-4203-952c-e62c6d5aff58 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:00.999880 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-92d452ce-7ef5-4203-952c-e62c6d5aff58 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 629fd4f8-24b5-4287-bfe2-ba789169bdb3] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:01.008726 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92d452ce-7ef5-4203-952c-e62c6d5aff58 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:01.010247 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92d452ce-7ef5-4203-952c-e62c6d5aff58 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:01.016183 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92d452ce-7ef5-4203-952c-e62c6d5aff58 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:01.017403 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92d452ce-7ef5-4203-952c-e62c6d5aff58 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:01.018126 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92d452ce-7ef5-4203-952c-e62c6d5aff58 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:01.018760 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-92d452ce-7ef5-4203-952c-e62c6d5aff58 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:01.036476 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-92d452ce-7ef5-4203-952c-e62c6d5aff58 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] HTTP exception thrown: Instance 629fd4f8-24b5-4287-bfe2-ba789169bdb3 could not be found. Sep 06 22:49:01.039296 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-92d452ce-7ef5-4203-952c-e62c6d5aff58 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Request method failure captured: Sep 06 22:49:01.039296 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3 HTTP/1.1 Sep 06 22:49:01.039296 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept: application/json Sep 06 22:49:01.039296 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Sep 06 22:49:01.039296 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Connection: close Sep 06 22:49:01.039296 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Length: 0 Sep 06 22:49:01.039296 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Type: application/json Sep 06 22:49:01.039296 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Host: 10.222.0.39 Sep 06 22:49:01.039296 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Sep 06 22:49:01.039296 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Sep 06 22:49:01.039296 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjF8zqxgSG46lj7OUxSmnOOLapQeLK_6hkI72B0BHV-jMoohA5Kb9QGJskm3XQLN61eC5nDBKhtCM_jesserHETb689YoksXKkxY5TlZimYO11KpoBkkL1idup5kLb3WBJDDGwPHr_9SXbj1IKgzToTdcJ7jlVZ1MFpP0aT-fod2Q58kQ Sep 06 22:49:01.039296 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Sep 06 22:49:01.039296 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Sep 06 22:49:01.039296 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Sep 06 22:49:01.039296 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Sep 06 22:49:01.039296 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Sep 06 22:49:01.039296 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Sep 06 22:49:01.039296 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Id: 817010ab38864d8aafb61140eb176da1 Sep 06 22:49:01.039296 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeTestJSON-601810619 Sep 06 22:49:01.039296 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Role: reader,member Sep 06 22:49:01.039296 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Sep 06 22:49:01.040617 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/817010ab38864d8aafb61140eb176da1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_817010ab38864d8aafb61140eb176da1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/817010ab38864d8aafb61140eb176da1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/817010ab38864d8aafb61140eb176da1"}]}] Sep 06 22:49:01.040617 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeTestJSON-601810619 Sep 06 22:49:01.040617 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 817010ab38864d8aafb61140eb176da1 Sep 06 22:49:01.040617 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeTestJSON-601810619 Sep 06 22:49:01.040617 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeTestJSON-601810619-project Sep 06 22:49:01.040617 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Sep 06 22:49:01.040617 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Sep 06 22:49:01.040617 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Id: 4dd9f0bff3044d7db561dff21ac0e7ff Sep 06 22:49:01.040617 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeTestJSON-601810619-project Sep 06 22:49:01.040617 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: method: > Sep 06 22:49:01.040617 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: exception: Instance 629fd4f8-24b5-4287-bfe2-ba789169bdb3 could not be found. Sep 06 22:49:01.040617 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: action_args: {'id': '629fd4f8-24b5-4287-bfe2-ba789169bdb3'} Sep 06 22:49:01.042941 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:49:01.042941 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:01.042941 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:49:01.042941 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:49:01.042941 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:49:01.042941 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:49:01.042941 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:49:01.042941 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:49:01.042941 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:49:01.042941 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:49:01.042941 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 629fd4f8-24b5-4287-bfe2-ba789169bdb3 could not be found. Sep 06 22:49:01.042941 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:49:01.042941 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:49:01.042941 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:49:01.042941 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:01.042941 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:49:01.042941 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:49:01.042941 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:49:01.042941 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:49:01.042941 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:49:01.044107 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:49:01.044107 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 22:49:01.044107 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 22:49:01.044107 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:49:01.044107 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:49:01.044107 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:49:01.044107 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:49:01.044107 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 629fd4f8-24b5-4287-bfe2-ba789169bdb3 could not be found. Sep 06 22:49:01.044107 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:49:01.044107 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:49:01.044107 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:49:01.044107 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:01.044107 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:49:01.044107 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:49:01.044107 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:49:01.044107 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:49:01.044107 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 629fd4f8-24b5-4287-bfe2-ba789169bdb3 could not be found. Sep 06 22:49:01.044107 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:49:01.046543 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-92d452ce-7ef5-4203-952c-e62c6d5aff58 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Returning 404 to user: Instance 629fd4f8-24b5-4287-bfe2-ba789169bdb3 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:49:01.047619 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-92d452ce-7ef5-4203-952c-e62c6d5aff58 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3" status: 404 len: 111 microversion: 2.1 time: 0.059314 Sep 06 22:49:01.052180 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 371/744] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:00 2022] GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 22:49:01.058417 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a2c458ac-e0bc-4a66-b1f3-aae8ce2b432e tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:01.059382 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a2c458ac-e0bc-4a66-b1f3-aae8ce2b432e tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] [instance: 9e1de8ed-ee4e-40d3-9f22-3560b08031b4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:01.066302 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a2c458ac-e0bc-4a66-b1f3-aae8ce2b432e tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:01.067090 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a2c458ac-e0bc-4a66-b1f3-aae8ce2b432e tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:01.067728 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a2c458ac-e0bc-4a66-b1f3-aae8ce2b432e tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:01.068950 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a2c458ac-e0bc-4a66-b1f3-aae8ce2b432e tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:01.069549 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a2c458ac-e0bc-4a66-b1f3-aae8ce2b432e tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:01.070228 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a2c458ac-e0bc-4a66-b1f3-aae8ce2b432e tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:01.135914 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-c9e3a070-4de7-4fc6-a955-6a8070ad3beb tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:01.149418 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-c9e3a070-4de7-4fc6-a955-6a8070ad3beb tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879" status: 200 len: 1266 microversion: 2.1 time: 0.690441 Sep 06 22:49:01.150911 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 374/745] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:00 2022] GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879 => generated 1266 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:01.164982 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6c072707-8d37-4010-82a9-f43a674b5c77 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '.version_select at 0x7f9c5303a820>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:01.206949 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-6c072707-8d37-4010-82a9-f43a674b5c77 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-735381543" status: 202 len: 0 microversion: 2.1 time: 0.053325 Sep 06 22:49:01.211438 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 375/746] 10.222.0.39 () {58 vars in 1218 bytes} [Tue Sep 6 22:49:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-735381543 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 22:49:01.476915 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-495d9a0d-5058-4507-892c-02bf9112ff58 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:01.477631 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-495d9a0d-5058-4507-892c-02bf9112ff58 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:01.489874 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a2c458ac-e0bc-4a66-b1f3-aae8ce2b432e tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5593dc049144447859a48e458717295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3e57c72cec4c128a09749da5a90a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:01.490144 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-495d9a0d-5058-4507-892c-02bf9112ff58 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:01.491025 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-495d9a0d-5058-4507-892c-02bf9112ff58 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:01.491522 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-495d9a0d-5058-4507-892c-02bf9112ff58 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:01.492440 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-495d9a0d-5058-4507-892c-02bf9112ff58 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:01.493096 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-495d9a0d-5058-4507-892c-02bf9112ff58 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:01.499160 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-495d9a0d-5058-4507-892c-02bf9112ff58 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:01.505188 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a2c458ac-e0bc-4a66-b1f3-aae8ce2b432e tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] 10.222.0.39 "GET /compute/v2.1/servers/9e1de8ed-ee4e-40d3-9f22-3560b08031b4" status: 200 len: 1313 microversion: 2.1 time: 0.447973 Sep 06 22:49:01.505811 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 372/747] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:01 2022] GET /compute/v2.1/servers/9e1de8ed-ee4e-40d3-9f22-3560b08031b4 => generated 1313 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:01.785425 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-21ee6223-02a4-4d90-ac18-fa70a8eebfe1 req-377598b9-7a27-4bc1-b072-6c3db999f84f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e1de8ed-ee4e-40d3-9f22-3560b08031b4", "tag": "6e1d28d1-0fb1-4f1d-ace2-687e1ba9eb83"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:49:01.797334 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-21ee6223-02a4-4d90-ac18-fa70a8eebfe1 req-377598b9-7a27-4bc1-b072-6c3db999f84f service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:01.799245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-21ee6223-02a4-4d90-ac18-fa70a8eebfe1 req-377598b9-7a27-4bc1-b072-6c3db999f84f service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:01.799778 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-21ee6223-02a4-4d90-ac18-fa70a8eebfe1 req-377598b9-7a27-4bc1-b072-6c3db999f84f service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:01.811454 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-495d9a0d-5058-4507-892c-02bf9112ff58 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:01.813919 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-21ee6223-02a4-4d90-ac18-fa70a8eebfe1 req-377598b9-7a27-4bc1-b072-6c3db999f84f service nova] Creating event network-changed:6e1d28d1-0fb1-4f1d-ace2-687e1ba9eb83 for instance 9e1de8ed-ee4e-40d3-9f22-3560b08031b4 on hv-cinder-85220 Sep 06 22:49:01.820310 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-21ee6223-02a4-4d90-ac18-fa70a8eebfe1 req-377598b9-7a27-4bc1-b072-6c3db999f84f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.238021 Sep 06 22:49:01.821272 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 373/748] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 22:49:01.824720 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-495d9a0d-5058-4507-892c-02bf9112ff58 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:01.826246 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-495d9a0d-5058-4507-892c-02bf9112ff58 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:01.827698 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-495d9a0d-5058-4507-892c-02bf9112ff58 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1740 microversion: 2.20 time: 0.357306 Sep 06 22:49:01.839142 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 376/749] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:49:01 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1740 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:49:01.865594 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-f75c2986-44e2-459b-b0f1-4f30bba00214 req-6102598d-b070-4d62-be77-5e9d3e0aee3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5acd0d35-4bad-4c55-853d-767fec050879", "tag": "5283334a-d586-42df-ac4b-7eae8c83bfd3"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:49:01.877384 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-f75c2986-44e2-459b-b0f1-4f30bba00214 req-6102598d-b070-4d62-be77-5e9d3e0aee3f service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:01.878162 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-f75c2986-44e2-459b-b0f1-4f30bba00214 req-6102598d-b070-4d62-be77-5e9d3e0aee3f service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:01.878787 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-f75c2986-44e2-459b-b0f1-4f30bba00214 req-6102598d-b070-4d62-be77-5e9d3e0aee3f service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:01.890619 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-f75c2986-44e2-459b-b0f1-4f30bba00214 req-6102598d-b070-4d62-be77-5e9d3e0aee3f service nova] Creating event network-changed:5283334a-d586-42df-ac4b-7eae8c83bfd3 for instance 5acd0d35-4bad-4c55-853d-767fec050879 on hv-cinder-85220 Sep 06 22:49:01.895759 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-f75c2986-44e2-459b-b0f1-4f30bba00214 req-6102598d-b070-4d62-be77-5e9d3e0aee3f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034771 Sep 06 22:49:01.896954 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 374/750] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:49:01.995014 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-be959a89-e5bc-4cc0-acf5-1fa4b7103acc tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:01.995667 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-be959a89-e5bc-4cc0-acf5-1fa4b7103acc tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:02.002116 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-be959a89-e5bc-4cc0-acf5-1fa4b7103acc tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:02.002640 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-be959a89-e5bc-4cc0-acf5-1fa4b7103acc tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:02.003075 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-be959a89-e5bc-4cc0-acf5-1fa4b7103acc tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:02.003760 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-be959a89-e5bc-4cc0-acf5-1fa4b7103acc tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:02.004264 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-be959a89-e5bc-4cc0-acf5-1fa4b7103acc tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:02.004676 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-be959a89-e5bc-4cc0-acf5-1fa4b7103acc tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:02.177397 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d6e3b658-cbfa-4f30-be86-5ccc146c4028 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:02.178876 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d6e3b658-cbfa-4f30-be86-5ccc146c4028 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 5acd0d35-4bad-4c55-853d-767fec050879] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:02.187718 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d6e3b658-cbfa-4f30-be86-5ccc146c4028 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:02.188466 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d6e3b658-cbfa-4f30-be86-5ccc146c4028 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:02.188956 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d6e3b658-cbfa-4f30-be86-5ccc146c4028 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:02.189665 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d6e3b658-cbfa-4f30-be86-5ccc146c4028 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:02.190370 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d6e3b658-cbfa-4f30-be86-5ccc146c4028 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:02.190885 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d6e3b658-cbfa-4f30-be86-5ccc146c4028 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:02.199249 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-be959a89-e5bc-4cc0-acf5-1fa4b7103acc tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:02.213778 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-be959a89-e5bc-4cc0-acf5-1fa4b7103acc tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1569 microversion: 2.1 time: 0.222653 Sep 06 22:49:02.229165 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 377/751] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:01 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1569 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:02.532030 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-21b80932-3d4e-46bd-a825-d1c4c4738b85 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:02.532719 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-21b80932-3d4e-46bd-a825-d1c4c4738b85 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] [instance: 9e1de8ed-ee4e-40d3-9f22-3560b08031b4] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:02.539926 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-21b80932-3d4e-46bd-a825-d1c4c4738b85 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:02.540525 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-21b80932-3d4e-46bd-a825-d1c4c4738b85 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:02.541636 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-21b80932-3d4e-46bd-a825-d1c4c4738b85 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:02.542568 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-21b80932-3d4e-46bd-a825-d1c4c4738b85 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:02.543444 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-21b80932-3d4e-46bd-a825-d1c4c4738b85 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:02.544090 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-21b80932-3d4e-46bd-a825-d1c4c4738b85 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:02.859788 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d6e3b658-cbfa-4f30-be86-5ccc146c4028 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:02.867399 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d6e3b658-cbfa-4f30-be86-5ccc146c4028 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879" status: 200 len: 1266 microversion: 2.1 time: 0.694279 Sep 06 22:49:02.867970 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 375/752] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:02 2022] GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879 => generated 1266 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:02.875896 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-da05ca5c-fa26-4b87-8251-cfe03d5180a2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:02.876499 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-da05ca5c-fa26-4b87-8251-cfe03d5180a2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:02.882106 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-da05ca5c-fa26-4b87-8251-cfe03d5180a2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:02.882588 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-da05ca5c-fa26-4b87-8251-cfe03d5180a2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:02.883014 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-da05ca5c-fa26-4b87-8251-cfe03d5180a2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:02.883696 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-da05ca5c-fa26-4b87-8251-cfe03d5180a2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:02.884148 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-da05ca5c-fa26-4b87-8251-cfe03d5180a2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:02.885207 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-da05ca5c-fa26-4b87-8251-cfe03d5180a2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:02.887398 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-21b80932-3d4e-46bd-a825-d1c4c4738b85 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5593dc049144447859a48e458717295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3e57c72cec4c128a09749da5a90a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:02.894926 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-21b80932-3d4e-46bd-a825-d1c4c4738b85 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] 10.222.0.39 "GET /compute/v2.1/servers/9e1de8ed-ee4e-40d3-9f22-3560b08031b4" status: 200 len: 1313 microversion: 2.1 time: 0.367123 Sep 06 22:49:02.895495 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 378/753] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:02 2022] GET /compute/v2.1/servers/9e1de8ed-ee4e-40d3-9f22-3560b08031b4 => generated 1313 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:03.016558 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-da05ca5c-fa26-4b87-8251-cfe03d5180a2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:03.024519 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-da05ca5c-fa26-4b87-8251-cfe03d5180a2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:03.026375 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-da05ca5c-fa26-4b87-8251-cfe03d5180a2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:03.027530 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-da05ca5c-fa26-4b87-8251-cfe03d5180a2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1722 microversion: 2.20 time: 0.155296 Sep 06 22:49:03.028095 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 376/754] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:49:02 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:49:03.241287 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6ec30275-63cf-4fe1-912d-cff53fc60a27 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:03.241890 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-6ec30275-63cf-4fe1-912d-cff53fc60a27 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:03.250159 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6ec30275-63cf-4fe1-912d-cff53fc60a27 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:03.250638 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6ec30275-63cf-4fe1-912d-cff53fc60a27 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:03.251066 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6ec30275-63cf-4fe1-912d-cff53fc60a27 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:03.251749 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6ec30275-63cf-4fe1-912d-cff53fc60a27 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:03.252191 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6ec30275-63cf-4fe1-912d-cff53fc60a27 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:03.252603 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6ec30275-63cf-4fe1-912d-cff53fc60a27 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:03.510123 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6ec30275-63cf-4fe1-912d-cff53fc60a27 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:03.518763 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-6ec30275-63cf-4fe1-912d-cff53fc60a27 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1570 microversion: 2.1 time: 0.281313 Sep 06 22:49:03.520801 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 379/755] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:03 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1570 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:03.542302 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-24678acf-17ae-4a2a-9c35-3ff4f7ac0617 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:49:03.543012 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-24678acf-17ae-4a2a-9c35-3ff4f7ac0617 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:03.550189 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-24678acf-17ae-4a2a-9c35-3ff4f7ac0617 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:03.550680 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-24678acf-17ae-4a2a-9c35-3ff4f7ac0617 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:03.551112 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-24678acf-17ae-4a2a-9c35-3ff4f7ac0617 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:03.551811 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-24678acf-17ae-4a2a-9c35-3ff4f7ac0617 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:03.552257 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-24678acf-17ae-4a2a-9c35-3ff4f7ac0617 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:03.552674 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-24678acf-17ae-4a2a-9c35-3ff4f7ac0617 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:03.583273 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-24678acf-17ae-4a2a-9c35-3ff4f7ac0617 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127088) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 06 22:49:03.652988 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-24678acf-17ae-4a2a-9c35-3ff4f7ac0617 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "POST /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de/action" status: 202 len: 0 microversion: 2.1 time: 0.115056 Sep 06 22:49:03.653592 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 377/756] 10.222.0.39 () {60 vars in 1278 bytes} [Tue Sep 6 22:49:03 2022] POST /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 22:49:03.661742 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6f48310a-ffd0-47f4-b8fe-b1a00962096b tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:03.662559 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-6f48310a-ffd0-47f4-b8fe-b1a00962096b tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:03.669239 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6f48310a-ffd0-47f4-b8fe-b1a00962096b tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:03.669714 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6f48310a-ffd0-47f4-b8fe-b1a00962096b tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:03.670140 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6f48310a-ffd0-47f4-b8fe-b1a00962096b tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:03.670821 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6f48310a-ffd0-47f4-b8fe-b1a00962096b tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:03.671261 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6f48310a-ffd0-47f4-b8fe-b1a00962096b tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:03.671666 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6f48310a-ffd0-47f4-b8fe-b1a00962096b tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:03.690574 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=2 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:03.899109 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-224820e7-f340-4133-80b8-6476606f433d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:03.899825 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-224820e7-f340-4133-80b8-6476606f433d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 5acd0d35-4bad-4c55-853d-767fec050879] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:03.911169 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-224820e7-f340-4133-80b8-6476606f433d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:03.912775 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-224820e7-f340-4133-80b8-6476606f433d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:03.913466 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-224820e7-f340-4133-80b8-6476606f433d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:03.914571 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-224820e7-f340-4133-80b8-6476606f433d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:03.915290 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-224820e7-f340-4133-80b8-6476606f433d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:03.916002 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-224820e7-f340-4133-80b8-6476606f433d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:04.169462 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6f48310a-ffd0-47f4-b8fe-b1a00962096b tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:04.177342 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-6f48310a-ffd0-47f4-b8fe-b1a00962096b tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1578 microversion: 2.1 time: 0.519458 Sep 06 22:49:04.178283 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 380/757] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:03 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1578 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:04.183573 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e109d149-df16-4304-86e2-5b9193f2aff1 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:04.184337 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e109d149-df16-4304-86e2-5b9193f2aff1 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] [instance: 9e1de8ed-ee4e-40d3-9f22-3560b08031b4] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:04.190475 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e109d149-df16-4304-86e2-5b9193f2aff1 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:04.191382 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e109d149-df16-4304-86e2-5b9193f2aff1 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:04.192222 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e109d149-df16-4304-86e2-5b9193f2aff1 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:04.193388 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e109d149-df16-4304-86e2-5b9193f2aff1 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:04.194047 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e109d149-df16-4304-86e2-5b9193f2aff1 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:04.194687 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e109d149-df16-4304-86e2-5b9193f2aff1 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:04.386703 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-224820e7-f340-4133-80b8-6476606f433d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:04.394421 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-224820e7-f340-4133-80b8-6476606f433d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879" status: 200 len: 1266 microversion: 2.1 time: 0.505798 Sep 06 22:49:04.395231 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 378/758] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:03 2022] GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879 => generated 1266 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:04.399887 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-89919f38-fae7-40c5-aa74-c5358f00d31c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:04.400857 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-89919f38-fae7-40c5-aa74-c5358f00d31c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:04.407239 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89919f38-fae7-40c5-aa74-c5358f00d31c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:04.407965 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89919f38-fae7-40c5-aa74-c5358f00d31c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:04.408564 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89919f38-fae7-40c5-aa74-c5358f00d31c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:04.409472 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89919f38-fae7-40c5-aa74-c5358f00d31c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:04.410100 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89919f38-fae7-40c5-aa74-c5358f00d31c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:04.410689 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89919f38-fae7-40c5-aa74-c5358f00d31c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:04.599058 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e109d149-df16-4304-86e2-5b9193f2aff1 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5593dc049144447859a48e458717295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3e57c72cec4c128a09749da5a90a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:04.607117 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e109d149-df16-4304-86e2-5b9193f2aff1 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] 10.222.0.39 "GET /compute/v2.1/servers/9e1de8ed-ee4e-40d3-9f22-3560b08031b4" status: 200 len: 1313 microversion: 2.1 time: 0.427639 Sep 06 22:49:04.607979 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 381/759] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:04 2022] GET /compute/v2.1/servers/9e1de8ed-ee4e-40d3-9f22-3560b08031b4 => generated 1313 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:04.676253 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d5858f7c-0c15-41de-afb8-354eec3329e0 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:04.676870 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-d5858f7c-0c15-41de-afb8-354eec3329e0 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 629fd4f8-24b5-4287-bfe2-ba789169bdb3] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:04.683545 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d5858f7c-0c15-41de-afb8-354eec3329e0 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:04.684106 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d5858f7c-0c15-41de-afb8-354eec3329e0 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:04.684607 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d5858f7c-0c15-41de-afb8-354eec3329e0 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:04.685393 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d5858f7c-0c15-41de-afb8-354eec3329e0 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:04.685958 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d5858f7c-0c15-41de-afb8-354eec3329e0 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:04.686442 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d5858f7c-0c15-41de-afb8-354eec3329e0 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:04.702535 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-d5858f7c-0c15-41de-afb8-354eec3329e0 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] HTTP exception thrown: Instance 629fd4f8-24b5-4287-bfe2-ba789169bdb3 could not be found. Sep 06 22:49:04.704235 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d5858f7c-0c15-41de-afb8-354eec3329e0 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Request method failure captured: Sep 06 22:49:04.704235 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: request: DELETE /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3 HTTP/1.1 Sep 06 22:49:04.704235 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept: application/json Sep 06 22:49:04.704235 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Sep 06 22:49:04.704235 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Connection: close Sep 06 22:49:04.704235 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Length: 0 Sep 06 22:49:04.704235 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Type: application/json Sep 06 22:49:04.704235 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Host: 10.222.0.39 Sep 06 22:49:04.704235 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Sep 06 22:49:04.704235 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.12 Sep 06 22:49:04.704235 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABjF8zqxgSG46lj7OUxSmnOOLapQeLK_6hkI72B0BHV-jMoohA5Kb9QGJskm3XQLN61eC5nDBKhtCM_jesserHETb689YoksXKkxY5TlZimYO11KpoBkkL1idup5kLb3WBJDDGwPHr_9SXbj1IKgzToTdcJ7jlVZ1MFpP0aT-fod2Q58kQ Sep 06 22:49:04.704235 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Sep 06 22:49:04.704235 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Sep 06 22:49:04.704235 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Sep 06 22:49:04.704235 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Sep 06 22:49:04.704235 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Sep 06 22:49:04.704235 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Sep 06 22:49:04.704235 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Id: 817010ab38864d8aafb61140eb176da1 Sep 06 22:49:04.704235 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-AttachVolumeTestJSON-601810619 Sep 06 22:49:04.704235 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Role: reader,member Sep 06 22:49:04.704235 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Sep 06 22:49:04.706183 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/817010ab38864d8aafb61140eb176da1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_817010ab38864d8aafb61140eb176da1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/817010ab38864d8aafb61140eb176da1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/817010ab38864d8aafb61140eb176da1"}]}] Sep 06 22:49:04.706183 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-AttachVolumeTestJSON-601810619 Sep 06 22:49:04.706183 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 817010ab38864d8aafb61140eb176da1 Sep 06 22:49:04.706183 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-AttachVolumeTestJSON-601810619 Sep 06 22:49:04.706183 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User: tempest-AttachVolumeTestJSON-601810619-project Sep 06 22:49:04.706183 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Sep 06 22:49:04.706183 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Sep 06 22:49:04.706183 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Id: 4dd9f0bff3044d7db561dff21ac0e7ff Sep 06 22:49:04.706183 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-AttachVolumeTestJSON-601810619-project Sep 06 22:49:04.706183 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: method: > Sep 06 22:49:04.706183 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: exception: Instance 629fd4f8-24b5-4287-bfe2-ba789169bdb3 could not be found. Sep 06 22:49:04.706183 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: action_args: {'id': '629fd4f8-24b5-4287-bfe2-ba789169bdb3'} Sep 06 22:49:04.707422 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:49:04.707422 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:04.707422 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:49:04.707422 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:49:04.707422 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:49:04.707422 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:49:04.707422 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:49:04.707422 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:49:04.707422 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:49:04.707422 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:49:04.707422 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 629fd4f8-24b5-4287-bfe2-ba789169bdb3 could not be found. Sep 06 22:49:04.707422 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:04.707422 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:49:04.707422 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:04.707422 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:04.707422 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:49:04.707422 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:49:04.707422 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:49:04.707422 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:49:04.707422 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:49:04.708591 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:49:04.708591 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 22:49:04.708591 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 22:49:04.708591 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 22:49:04.708591 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 22:49:04.708591 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:49:04.708591 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:49:04.708591 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:49:04.708591 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:49:04.708591 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 629fd4f8-24b5-4287-bfe2-ba789169bdb3 could not be found. Sep 06 22:49:04.708591 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:04.708591 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:49:04.708591 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:04.708591 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:04.708591 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:49:04.708591 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:49:04.708591 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:49:04.708591 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:49:04.708591 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 629fd4f8-24b5-4287-bfe2-ba789169bdb3 could not be found. Sep 06 22:49:04.708591 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:04.711791 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d5858f7c-0c15-41de-afb8-354eec3329e0 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Returning 404 to user: Instance 629fd4f8-24b5-4287-bfe2-ba789169bdb3 could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:49:04.711791 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d5858f7c-0c15-41de-afb8-354eec3329e0 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "DELETE /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3" status: 404 len: 111 microversion: 2.1 time: 0.033281 Sep 06 22:49:04.711791 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 382/760] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Sep 6 22:49:04 2022] DELETE /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 22:49:04.715014 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-29c16179-e20d-4af2-8523-c715b39c2c97 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:04.715622 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-29c16179-e20d-4af2-8523-c715b39c2c97 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 629fd4f8-24b5-4287-bfe2-ba789169bdb3] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:04.721879 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-29c16179-e20d-4af2-8523-c715b39c2c97 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:04.722359 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-29c16179-e20d-4af2-8523-c715b39c2c97 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:04.722792 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-29c16179-e20d-4af2-8523-c715b39c2c97 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:04.723482 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-29c16179-e20d-4af2-8523-c715b39c2c97 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:04.723926 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-29c16179-e20d-4af2-8523-c715b39c2c97 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:04.724336 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-29c16179-e20d-4af2-8523-c715b39c2c97 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:04.738125 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-29c16179-e20d-4af2-8523-c715b39c2c97 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] HTTP exception thrown: Instance 629fd4f8-24b5-4287-bfe2-ba789169bdb3 could not be found. Sep 06 22:49:04.739650 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-29c16179-e20d-4af2-8523-c715b39c2c97 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Request method failure captured: Sep 06 22:49:04.739650 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: request: GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3 HTTP/1.1 Sep 06 22:49:04.739650 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept: application/json Sep 06 22:49:04.739650 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Sep 06 22:49:04.739650 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Connection: close Sep 06 22:49:04.739650 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Length: 0 Sep 06 22:49:04.739650 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Type: application/json Sep 06 22:49:04.739650 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Host: 10.222.0.39 Sep 06 22:49:04.739650 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Sep 06 22:49:04.739650 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.12 Sep 06 22:49:04.739650 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABjF8zqxgSG46lj7OUxSmnOOLapQeLK_6hkI72B0BHV-jMoohA5Kb9QGJskm3XQLN61eC5nDBKhtCM_jesserHETb689YoksXKkxY5TlZimYO11KpoBkkL1idup5kLb3WBJDDGwPHr_9SXbj1IKgzToTdcJ7jlVZ1MFpP0aT-fod2Q58kQ Sep 06 22:49:04.739650 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Sep 06 22:49:04.739650 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Sep 06 22:49:04.739650 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Sep 06 22:49:04.739650 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Sep 06 22:49:04.739650 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Sep 06 22:49:04.739650 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Sep 06 22:49:04.739650 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Id: 817010ab38864d8aafb61140eb176da1 Sep 06 22:49:04.739650 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-AttachVolumeTestJSON-601810619 Sep 06 22:49:04.739650 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Role: reader,member Sep 06 22:49:04.739650 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Sep 06 22:49:04.741161 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/817010ab38864d8aafb61140eb176da1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_817010ab38864d8aafb61140eb176da1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/817010ab38864d8aafb61140eb176da1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/817010ab38864d8aafb61140eb176da1"}]}] Sep 06 22:49:04.741161 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-AttachVolumeTestJSON-601810619 Sep 06 22:49:04.741161 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 817010ab38864d8aafb61140eb176da1 Sep 06 22:49:04.741161 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-AttachVolumeTestJSON-601810619 Sep 06 22:49:04.741161 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User: tempest-AttachVolumeTestJSON-601810619-project Sep 06 22:49:04.741161 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Sep 06 22:49:04.741161 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Sep 06 22:49:04.741161 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Id: 4dd9f0bff3044d7db561dff21ac0e7ff Sep 06 22:49:04.741161 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-AttachVolumeTestJSON-601810619-project Sep 06 22:49:04.741161 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: method: > Sep 06 22:49:04.741161 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: exception: Instance 629fd4f8-24b5-4287-bfe2-ba789169bdb3 could not be found. Sep 06 22:49:04.741161 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: action_args: {'id': '629fd4f8-24b5-4287-bfe2-ba789169bdb3'} Sep 06 22:49:04.742025 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:49:04.742025 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:04.742025 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:49:04.742025 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:49:04.742025 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:49:04.742025 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:49:04.742025 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:49:04.742025 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:49:04.742025 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:49:04.742025 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:49:04.742025 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 629fd4f8-24b5-4287-bfe2-ba789169bdb3 could not be found. Sep 06 22:49:04.742025 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:04.742025 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:49:04.742025 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:04.742025 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:04.742025 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:49:04.742025 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:49:04.742025 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:49:04.742025 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:49:04.742025 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:49:04.743285 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:49:04.743285 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 22:49:04.743285 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 22:49:04.743285 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:49:04.743285 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:49:04.743285 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:49:04.743285 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:49:04.743285 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 629fd4f8-24b5-4287-bfe2-ba789169bdb3 could not be found. Sep 06 22:49:04.743285 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:04.743285 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:49:04.743285 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:04.743285 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:04.743285 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:49:04.743285 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:49:04.743285 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:49:04.743285 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:49:04.743285 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 629fd4f8-24b5-4287-bfe2-ba789169bdb3 could not be found. Sep 06 22:49:04.743285 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:04.745857 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-29c16179-e20d-4af2-8523-c715b39c2c97 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Returning 404 to user: Instance 629fd4f8-24b5-4287-bfe2-ba789169bdb3 could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:49:04.746698 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-29c16179-e20d-4af2-8523-c715b39c2c97 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3" status: 404 len: 111 microversion: 2.1 time: 0.036459 Sep 06 22:49:04.747255 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 383/761] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:04 2022] GET /compute/v2.1/servers/629fd4f8-24b5-4287-bfe2-ba789169bdb3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 22:49:04.757704 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-89919f38-fae7-40c5-aa74-c5358f00d31c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:04.769106 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-89919f38-fae7-40c5-aa74-c5358f00d31c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:04.770615 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-89919f38-fae7-40c5-aa74-c5358f00d31c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:04.771809 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-89919f38-fae7-40c5-aa74-c5358f00d31c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1722 microversion: 2.20 time: 0.375492 Sep 06 22:49:04.772362 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 379/762] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:49:04 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1722 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:49:05.205316 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-cba93eba-0230-4258-95e9-bd5d50ae047d tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:05.205912 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-cba93eba-0230-4258-95e9-bd5d50ae047d tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:05.211796 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cba93eba-0230-4258-95e9-bd5d50ae047d tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:05.212263 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cba93eba-0230-4258-95e9-bd5d50ae047d tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:05.212685 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cba93eba-0230-4258-95e9-bd5d50ae047d tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:05.213387 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cba93eba-0230-4258-95e9-bd5d50ae047d tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:05.213849 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cba93eba-0230-4258-95e9-bd5d50ae047d tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:05.214329 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cba93eba-0230-4258-95e9-bd5d50ae047d tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:05.344646 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-cba93eba-0230-4258-95e9-bd5d50ae047d tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:05.352238 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-cba93eba-0230-4258-95e9-bd5d50ae047d tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1520 microversion: 2.1 time: 0.150828 Sep 06 22:49:05.352809 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 384/763] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:05 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:05.419157 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-027a5996-a09d-48e0-8894-e7f9feb7e940 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:05.419766 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-027a5996-a09d-48e0-8894-e7f9feb7e940 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 5acd0d35-4bad-4c55-853d-767fec050879] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:05.425638 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-027a5996-a09d-48e0-8894-e7f9feb7e940 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:05.426121 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-027a5996-a09d-48e0-8894-e7f9feb7e940 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:05.426554 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-027a5996-a09d-48e0-8894-e7f9feb7e940 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:05.427239 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-027a5996-a09d-48e0-8894-e7f9feb7e940 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:05.427689 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-027a5996-a09d-48e0-8894-e7f9feb7e940 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:05.428107 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-027a5996-a09d-48e0-8894-e7f9feb7e940 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:05.447238 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:05.558514 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-027a5996-a09d-48e0-8894-e7f9feb7e940 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:05.566156 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-027a5996-a09d-48e0-8894-e7f9feb7e940 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879" status: 200 len: 1266 microversion: 2.1 time: 0.151731 Sep 06 22:49:05.566723 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 380/764] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:05 2022] GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:05.630704 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b9ff15bb-2d53-4205-9594-49dc63b6ef13 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:05.631305 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b9ff15bb-2d53-4205-9594-49dc63b6ef13 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] [instance: 9e1de8ed-ee4e-40d3-9f22-3560b08031b4] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:05.637339 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b9ff15bb-2d53-4205-9594-49dc63b6ef13 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:05.637807 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b9ff15bb-2d53-4205-9594-49dc63b6ef13 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:05.638231 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b9ff15bb-2d53-4205-9594-49dc63b6ef13 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:05.638905 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b9ff15bb-2d53-4205-9594-49dc63b6ef13 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:05.639343 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b9ff15bb-2d53-4205-9594-49dc63b6ef13 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:05.639752 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b9ff15bb-2d53-4205-9594-49dc63b6ef13 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:05.768164 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b9ff15bb-2d53-4205-9594-49dc63b6ef13 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5593dc049144447859a48e458717295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3e57c72cec4c128a09749da5a90a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:05.775590 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b9ff15bb-2d53-4205-9594-49dc63b6ef13 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] 10.222.0.39 "GET /compute/v2.1/servers/9e1de8ed-ee4e-40d3-9f22-3560b08031b4" status: 200 len: 1313 microversion: 2.1 time: 0.148734 Sep 06 22:49:05.776691 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 385/765] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:05 2022] GET /compute/v2.1/servers/9e1de8ed-ee4e-40d3-9f22-3560b08031b4 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:05.798134 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7937ae4a-f821-42f7-bc30-f06529a94905 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:05.798737 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7937ae4a-f821-42f7-bc30-f06529a94905 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:05.804532 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7937ae4a-f821-42f7-bc30-f06529a94905 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:05.805044 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7937ae4a-f821-42f7-bc30-f06529a94905 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:05.805468 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7937ae4a-f821-42f7-bc30-f06529a94905 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:05.806197 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7937ae4a-f821-42f7-bc30-f06529a94905 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:05.806590 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7937ae4a-f821-42f7-bc30-f06529a94905 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:05.807031 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7937ae4a-f821-42f7-bc30-f06529a94905 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:05.894471 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-52a422c3-10aa-45d2-97e2-8fb4f4485162 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:05.895117 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-52a422c3-10aa-45d2-97e2-8fb4f4485162 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:05.904106 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-52a422c3-10aa-45d2-97e2-8fb4f4485162 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:05.904329 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-52a422c3-10aa-45d2-97e2-8fb4f4485162 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:05.904817 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-52a422c3-10aa-45d2-97e2-8fb4f4485162 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:05.906171 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-52a422c3-10aa-45d2-97e2-8fb4f4485162 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:05.906684 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-52a422c3-10aa-45d2-97e2-8fb4f4485162 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:05.907767 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-52a422c3-10aa-45d2-97e2-8fb4f4485162 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:05.925204 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-52a422c3-10aa-45d2-97e2-8fb4f4485162 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] HTTP exception thrown: Instance 7bd3f7df-0b7f-451c-b6ea-c91792e466e5 could not be found. Sep 06 22:49:05.926880 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-52a422c3-10aa-45d2-97e2-8fb4f4485162 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Request method failure captured: Sep 06 22:49:05.926880 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: request: DELETE /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 HTTP/1.1 Sep 06 22:49:05.926880 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept: application/json Sep 06 22:49:05.926880 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Sep 06 22:49:05.926880 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Connection: close Sep 06 22:49:05.926880 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Length: 0 Sep 06 22:49:05.926880 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Type: application/json Sep 06 22:49:05.926880 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Host: 10.222.0.39 Sep 06 22:49:05.926880 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Sep 06 22:49:05.926880 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.12 Sep 06 22:49:05.926880 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABjF8zqxgSG46lj7OUxSmnOOLapQeLK_6hkI72B0BHV-jMoohA5Kb9QGJskm3XQLN61eC5nDBKhtCM_jesserHETb689YoksXKkxY5TlZimYO11KpoBkkL1idup5kLb3WBJDDGwPHr_9SXbj1IKgzToTdcJ7jlVZ1MFpP0aT-fod2Q58kQ Sep 06 22:49:05.926880 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Sep 06 22:49:05.926880 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Sep 06 22:49:05.926880 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Sep 06 22:49:05.926880 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Sep 06 22:49:05.926880 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Sep 06 22:49:05.926880 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Sep 06 22:49:05.926880 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Id: 817010ab38864d8aafb61140eb176da1 Sep 06 22:49:05.926880 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-AttachVolumeTestJSON-601810619 Sep 06 22:49:05.926880 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Role: reader,member Sep 06 22:49:05.926880 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Sep 06 22:49:05.928448 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/817010ab38864d8aafb61140eb176da1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_817010ab38864d8aafb61140eb176da1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/817010ab38864d8aafb61140eb176da1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/817010ab38864d8aafb61140eb176da1"}]}] Sep 06 22:49:05.928448 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-AttachVolumeTestJSON-601810619 Sep 06 22:49:05.928448 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 817010ab38864d8aafb61140eb176da1 Sep 06 22:49:05.928448 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-AttachVolumeTestJSON-601810619 Sep 06 22:49:05.928448 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User: tempest-AttachVolumeTestJSON-601810619-project Sep 06 22:49:05.928448 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Sep 06 22:49:05.928448 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Sep 06 22:49:05.928448 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Id: 4dd9f0bff3044d7db561dff21ac0e7ff Sep 06 22:49:05.928448 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-AttachVolumeTestJSON-601810619-project Sep 06 22:49:05.928448 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: method: > Sep 06 22:49:05.928448 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: exception: Instance 7bd3f7df-0b7f-451c-b6ea-c91792e466e5 could not be found. Sep 06 22:49:05.928448 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: action_args: {'id': '7bd3f7df-0b7f-451c-b6ea-c91792e466e5'} Sep 06 22:49:05.929334 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:49:05.929334 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:05.929334 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:49:05.929334 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:49:05.929334 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:49:05.929334 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:49:05.929334 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:49:05.929334 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:49:05.929334 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:49:05.929334 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:49:05.929334 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bd3f7df-0b7f-451c-b6ea-c91792e466e5 could not be found. Sep 06 22:49:05.929334 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:05.929334 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:49:05.929334 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:05.929334 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:05.929334 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:49:05.929334 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:49:05.929334 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:49:05.929334 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:49:05.929334 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:49:05.930805 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:49:05.930805 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 22:49:05.930805 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 22:49:05.930805 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 22:49:05.930805 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 22:49:05.930805 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:49:05.930805 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:49:05.930805 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:49:05.930805 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:49:05.930805 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bd3f7df-0b7f-451c-b6ea-c91792e466e5 could not be found. Sep 06 22:49:05.930805 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:05.930805 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:49:05.930805 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:05.930805 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:05.930805 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:49:05.930805 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:49:05.930805 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:49:05.930805 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:49:05.930805 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bd3f7df-0b7f-451c-b6ea-c91792e466e5 could not be found. Sep 06 22:49:05.930805 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:05.932288 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-52a422c3-10aa-45d2-97e2-8fb4f4485162 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Returning 404 to user: Instance 7bd3f7df-0b7f-451c-b6ea-c91792e466e5 could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:49:05.932288 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-52a422c3-10aa-45d2-97e2-8fb4f4485162 tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 404 len: 111 microversion: 2.1 time: 0.040587 Sep 06 22:49:05.932663 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 386/766] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Sep 6 22:49:05 2022] DELETE /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 22:49:05.937960 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-9a154d0a-1d54-4e86-8e86-dc4cb12d8912 req-c8edbb42-bd3d-4db4-ace5-995ebf0ece13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e1de8ed-ee4e-40d3-9f22-3560b08031b4", "name": "network-vif-plugged", "status": "completed", "tag": "6e1d28d1-0fb1-4f1d-ace2-687e1ba9eb83"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:49:05.947438 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-9a154d0a-1d54-4e86-8e86-dc4cb12d8912 req-c8edbb42-bd3d-4db4-ace5-995ebf0ece13 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:05.948531 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-9a154d0a-1d54-4e86-8e86-dc4cb12d8912 req-c8edbb42-bd3d-4db4-ace5-995ebf0ece13 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:05.949169 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-9a154d0a-1d54-4e86-8e86-dc4cb12d8912 req-c8edbb42-bd3d-4db4-ace5-995ebf0ece13 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:05.955673 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7937ae4a-f821-42f7-bc30-f06529a94905 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:05.960727 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-9a154d0a-1d54-4e86-8e86-dc4cb12d8912 req-c8edbb42-bd3d-4db4-ace5-995ebf0ece13 service nova] Creating event network-vif-plugged:6e1d28d1-0fb1-4f1d-ace2-687e1ba9eb83 for instance 9e1de8ed-ee4e-40d3-9f22-3560b08031b4 on hv-cinder-85220 Sep 06 22:49:05.967575 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-9a154d0a-1d54-4e86-8e86-dc4cb12d8912 req-c8edbb42-bd3d-4db4-ace5-995ebf0ece13 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032970 Sep 06 22:49:05.967929 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7937ae4a-f821-42f7-bc30-f06529a94905 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:05.968514 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 387/767] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:49:05.969553 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7937ae4a-f821-42f7-bc30-f06529a94905 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:05.970916 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7937ae4a-f821-42f7-bc30-f06529a94905 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1722 microversion: 2.20 time: 0.176882 Sep 06 22:49:05.972080 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 381/768] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:49:05 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:49:05.973714 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-cec2e005-891c-45b5-aa63-4f6172ba447d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:05.974417 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-cec2e005-891c-45b5-aa63-4f6172ba447d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] [instance: 7bd3f7df-0b7f-451c-b6ea-c91792e466e5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:05.981965 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cec2e005-891c-45b5-aa63-4f6172ba447d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:05.982453 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cec2e005-891c-45b5-aa63-4f6172ba447d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:05.982884 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cec2e005-891c-45b5-aa63-4f6172ba447d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:05.983575 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cec2e005-891c-45b5-aa63-4f6172ba447d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:05.984020 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cec2e005-891c-45b5-aa63-4f6172ba447d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:05.984614 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cec2e005-891c-45b5-aa63-4f6172ba447d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:06.001586 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-cec2e005-891c-45b5-aa63-4f6172ba447d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] HTTP exception thrown: Instance 7bd3f7df-0b7f-451c-b6ea-c91792e466e5 could not be found. Sep 06 22:49:06.003244 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-cec2e005-891c-45b5-aa63-4f6172ba447d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Request method failure captured: Sep 06 22:49:06.003244 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: request: GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 HTTP/1.1 Sep 06 22:49:06.003244 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept: application/json Sep 06 22:49:06.003244 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Sep 06 22:49:06.003244 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Connection: close Sep 06 22:49:06.003244 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Length: 0 Sep 06 22:49:06.003244 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Type: application/json Sep 06 22:49:06.003244 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Host: 10.222.0.39 Sep 06 22:49:06.003244 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Sep 06 22:49:06.003244 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.12 Sep 06 22:49:06.003244 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABjF8zqxgSG46lj7OUxSmnOOLapQeLK_6hkI72B0BHV-jMoohA5Kb9QGJskm3XQLN61eC5nDBKhtCM_jesserHETb689YoksXKkxY5TlZimYO11KpoBkkL1idup5kLb3WBJDDGwPHr_9SXbj1IKgzToTdcJ7jlVZ1MFpP0aT-fod2Q58kQ Sep 06 22:49:06.003244 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Sep 06 22:49:06.003244 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Sep 06 22:49:06.003244 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Sep 06 22:49:06.003244 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Sep 06 22:49:06.003244 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Sep 06 22:49:06.003244 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Sep 06 22:49:06.003244 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Id: 817010ab38864d8aafb61140eb176da1 Sep 06 22:49:06.003244 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-AttachVolumeTestJSON-601810619 Sep 06 22:49:06.003244 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Role: reader,member Sep 06 22:49:06.003244 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Sep 06 22:49:06.004885 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/817010ab38864d8aafb61140eb176da1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_817010ab38864d8aafb61140eb176da1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/817010ab38864d8aafb61140eb176da1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/817010ab38864d8aafb61140eb176da1"}]}] Sep 06 22:49:06.004885 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-AttachVolumeTestJSON-601810619 Sep 06 22:49:06.004885 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 817010ab38864d8aafb61140eb176da1 Sep 06 22:49:06.004885 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-AttachVolumeTestJSON-601810619 Sep 06 22:49:06.004885 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User: tempest-AttachVolumeTestJSON-601810619-project Sep 06 22:49:06.004885 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Sep 06 22:49:06.004885 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Sep 06 22:49:06.004885 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Id: 4dd9f0bff3044d7db561dff21ac0e7ff Sep 06 22:49:06.004885 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-AttachVolumeTestJSON-601810619-project Sep 06 22:49:06.004885 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: method: > Sep 06 22:49:06.004885 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: exception: Instance 7bd3f7df-0b7f-451c-b6ea-c91792e466e5 could not be found. Sep 06 22:49:06.004885 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: action_args: {'id': '7bd3f7df-0b7f-451c-b6ea-c91792e466e5'} Sep 06 22:49:06.009241 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:49:06.009241 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:06.009241 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:49:06.009241 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:49:06.009241 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:49:06.009241 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:49:06.009241 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:49:06.009241 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:49:06.009241 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:49:06.009241 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:49:06.009241 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bd3f7df-0b7f-451c-b6ea-c91792e466e5 could not be found. Sep 06 22:49:06.009241 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:06.009241 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:49:06.009241 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:06.009241 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:06.009241 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:49:06.009241 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:49:06.009241 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:49:06.009241 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:49:06.009241 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:49:06.011323 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:49:06.011323 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 22:49:06.011323 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 22:49:06.011323 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:49:06.011323 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:49:06.011323 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:49:06.011323 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:49:06.011323 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bd3f7df-0b7f-451c-b6ea-c91792e466e5 could not be found. Sep 06 22:49:06.011323 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:06.011323 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:49:06.011323 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:06.011323 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:06.011323 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:49:06.011323 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:49:06.011323 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:49:06.011323 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:49:06.011323 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bd3f7df-0b7f-451c-b6ea-c91792e466e5 could not be found. Sep 06 22:49:06.011323 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:06.012996 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-cec2e005-891c-45b5-aa63-4f6172ba447d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] Returning 404 to user: Instance 7bd3f7df-0b7f-451c-b6ea-c91792e466e5 could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:49:06.012996 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-cec2e005-891c-45b5-aa63-4f6172ba447d tempest-AttachVolumeTestJSON-601810619 tempest-AttachVolumeTestJSON-601810619-project] 10.222.0.39 "GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5" status: 404 len: 111 microversion: 2.1 time: 0.034985 Sep 06 22:49:06.012996 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 388/769] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:05 2022] GET /compute/v2.1/servers/7bd3f7df-0b7f-451c-b6ea-c91792e466e5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 22:49:06.382210 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d00a928b-a5b0-4298-bf31-b9be6ab16f44 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:06.389351 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d00a928b-a5b0-4298-bf31-b9be6ab16f44 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:06.403280 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d00a928b-a5b0-4298-bf31-b9be6ab16f44 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:06.404216 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d00a928b-a5b0-4298-bf31-b9be6ab16f44 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:06.405235 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d00a928b-a5b0-4298-bf31-b9be6ab16f44 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:06.405580 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d00a928b-a5b0-4298-bf31-b9be6ab16f44 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:06.406189 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d00a928b-a5b0-4298-bf31-b9be6ab16f44 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:06.406774 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d00a928b-a5b0-4298-bf31-b9be6ab16f44 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:06.589681 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ac03c595-7c52-4123-8bf3-7166d07406df tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:06.590400 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ac03c595-7c52-4123-8bf3-7166d07406df tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 5acd0d35-4bad-4c55-853d-767fec050879] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:06.597003 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ac03c595-7c52-4123-8bf3-7166d07406df tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:06.597637 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ac03c595-7c52-4123-8bf3-7166d07406df tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:06.598038 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ac03c595-7c52-4123-8bf3-7166d07406df tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:06.598908 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ac03c595-7c52-4123-8bf3-7166d07406df tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:06.599714 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ac03c595-7c52-4123-8bf3-7166d07406df tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:06.600341 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ac03c595-7c52-4123-8bf3-7166d07406df tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:06.783248 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d00a928b-a5b0-4298-bf31-b9be6ab16f44 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:06.790917 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d00a928b-a5b0-4298-bf31-b9be6ab16f44 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1520 microversion: 2.1 time: 0.417396 Sep 06 22:49:06.791581 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 382/770] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:06 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1520 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:06.813336 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4ec64f09-0f42-405a-93d1-6677be619681 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:06.814053 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4ec64f09-0f42-405a-93d1-6677be619681 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] [instance: 9e1de8ed-ee4e-40d3-9f22-3560b08031b4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:06.820407 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4ec64f09-0f42-405a-93d1-6677be619681 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:06.820931 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4ec64f09-0f42-405a-93d1-6677be619681 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:06.821368 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4ec64f09-0f42-405a-93d1-6677be619681 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:06.822125 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4ec64f09-0f42-405a-93d1-6677be619681 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:06.822580 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4ec64f09-0f42-405a-93d1-6677be619681 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:06.823554 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4ec64f09-0f42-405a-93d1-6677be619681 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:06.857707 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ac03c595-7c52-4123-8bf3-7166d07406df tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:06.865332 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ac03c595-7c52-4123-8bf3-7166d07406df tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879" status: 200 len: 1266 microversion: 2.1 time: 0.280304 Sep 06 22:49:06.865900 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 389/771] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:06 2022] GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879 => generated 1266 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:49:06.996690 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ad1ec5b4-52aa-4787-9f4c-379c90b3070f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:06.997354 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ad1ec5b4-52aa-4787-9f4c-379c90b3070f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:07.003316 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ad1ec5b4-52aa-4787-9f4c-379c90b3070f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:07.003791 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ad1ec5b4-52aa-4787-9f4c-379c90b3070f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:07.004223 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ad1ec5b4-52aa-4787-9f4c-379c90b3070f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:07.004941 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ad1ec5b4-52aa-4787-9f4c-379c90b3070f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:07.005414 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ad1ec5b4-52aa-4787-9f4c-379c90b3070f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:07.005829 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ad1ec5b4-52aa-4787-9f4c-379c90b3070f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:07.041278 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4ec64f09-0f42-405a-93d1-6677be619681 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5593dc049144447859a48e458717295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3e57c72cec4c128a09749da5a90a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:07.049531 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4ec64f09-0f42-405a-93d1-6677be619681 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] 10.222.0.39 "GET /compute/v2.1/servers/9e1de8ed-ee4e-40d3-9f22-3560b08031b4" status: 200 len: 1313 microversion: 2.1 time: 0.239969 Sep 06 22:49:07.050322 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 383/772] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:06 2022] GET /compute/v2.1/servers/9e1de8ed-ee4e-40d3-9f22-3560b08031b4 => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:07.581674 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ad1ec5b4-52aa-4787-9f4c-379c90b3070f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:07.590937 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ad1ec5b4-52aa-4787-9f4c-379c90b3070f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:07.592387 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ad1ec5b4-52aa-4787-9f4c-379c90b3070f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:07.593815 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ad1ec5b4-52aa-4787-9f4c-379c90b3070f tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1725 microversion: 2.20 time: 0.602118 Sep 06 22:49:07.594481 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 390/773] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:49:06 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1725 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 22:49:07.618997 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d1ddbbfe-4e9c-4805-93de-33ea7684a6ff tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8de50623-4d71-42c9-b384-08c86768df4e"}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:49:07.622277 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d1ddbbfe-4e9c-4805-93de-33ea7684a6ff tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:07.628653 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d1ddbbfe-4e9c-4805-93de-33ea7684a6ff tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:07.629173 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d1ddbbfe-4e9c-4805-93de-33ea7684a6ff tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:07.629609 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d1ddbbfe-4e9c-4805-93de-33ea7684a6ff tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:07.630330 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d1ddbbfe-4e9c-4805-93de-33ea7684a6ff tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:07.630781 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d1ddbbfe-4e9c-4805-93de-33ea7684a6ff tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:07.631207 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d1ddbbfe-4e9c-4805-93de-33ea7684a6ff tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:07.680996 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:07.699062 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=8 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:07.817377 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-286639d3-12bf-493f-b612-6c889e55775b tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:07.818385 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-286639d3-12bf-493f-b612-6c889e55775b tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:07.826112 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-286639d3-12bf-493f-b612-6c889e55775b tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:07.826564 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-286639d3-12bf-493f-b612-6c889e55775b tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:07.827044 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-286639d3-12bf-493f-b612-6c889e55775b tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:07.828019 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-286639d3-12bf-493f-b612-6c889e55775b tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:07.828569 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-286639d3-12bf-493f-b612-6c889e55775b tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:07.829120 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-286639d3-12bf-493f-b612-6c889e55775b tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:07.987304 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d1ddbbfe-4e9c-4805-93de-33ea7684a6ff tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "POST /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.372491 Sep 06 22:49:07.988017 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 384/774] 10.222.0.39 () {62 vars in 1364 bytes} [Tue Sep 6 22:49:07 2022] POST /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5/os-volume_attachments => generated 188 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 22:49:07.992740 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-911dbd43-2372-44f5-9ae1-554b3d8c213d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:07.993361 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-911dbd43-2372-44f5-9ae1-554b3d8c213d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 5acd0d35-4bad-4c55-853d-767fec050879] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:08.000386 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-911dbd43-2372-44f5-9ae1-554b3d8c213d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:08.000912 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-911dbd43-2372-44f5-9ae1-554b3d8c213d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:08.001353 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-911dbd43-2372-44f5-9ae1-554b3d8c213d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:08.002051 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-911dbd43-2372-44f5-9ae1-554b3d8c213d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:08.002499 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-911dbd43-2372-44f5-9ae1-554b3d8c213d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:08.002955 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-911dbd43-2372-44f5-9ae1-554b3d8c213d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:08.122532 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-286639d3-12bf-493f-b612-6c889e55775b tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:08.132705 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-286639d3-12bf-493f-b612-6c889e55775b tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1576 microversion: 2.1 time: 0.319427 Sep 06 22:49:08.133304 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 391/775] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:07 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1576 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:08.138542 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-4dd3e5fe-f034-48fd-b822-ea15b6ad75f4 req-35167f41-2db9-4092-9ec2-b905ad7e8f1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43a8e21a-339a-4ea5-ad07-4d74e92be9de", "name": "network-vif-unplugged", "status": "completed", "tag": "1501f706-7e9c-4f45-b83a-b0e52d8d1f26"}, {"server_uuid": "c781a9d5-f194-47b8-870d-eab1adcc1ad5", "name": "network-vif-unplugged", "status": "completed", "tag": "e9150456-138e-49eb-8d2d-f86cecea4bae"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:49:08.152954 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-4dd3e5fe-f034-48fd-b822-ea15b6ad75f4 req-35167f41-2db9-4092-9ec2-b905ad7e8f1a service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:08.153592 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-4dd3e5fe-f034-48fd-b822-ea15b6ad75f4 req-35167f41-2db9-4092-9ec2-b905ad7e8f1a service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:08.154076 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-4dd3e5fe-f034-48fd-b822-ea15b6ad75f4 req-35167f41-2db9-4092-9ec2-b905ad7e8f1a service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:08.171979 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-4dd3e5fe-f034-48fd-b822-ea15b6ad75f4 req-35167f41-2db9-4092-9ec2-b905ad7e8f1a service nova] Creating event network-vif-unplugged:1501f706-7e9c-4f45-b83a-b0e52d8d1f26 for instance 43a8e21a-339a-4ea5-ad07-4d74e92be9de on hv-cinder-85220 Sep 06 22:49:08.172499 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.compute.server_external_events [req-4dd3e5fe-f034-48fd-b822-ea15b6ad75f4 req-35167f41-2db9-4092-9ec2-b905ad7e8f1a service nova] Unable to find a host for instance c781a9d5-f194-47b8-870d-eab1adcc1ad5. Dropping event network-vif-unplugged {{(pid=127087) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 06 22:49:08.178186 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-4dd3e5fe-f034-48fd-b822-ea15b6ad75f4 req-35167f41-2db9-4092-9ec2-b905ad7e8f1a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 355 microversion: 2.1 time: 0.042998 Sep 06 22:49:08.181517 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 392/776] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 355 bytes in 47 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 06 22:49:08.188620 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e9f10e96-020e-4824-8819-1b65bd2f3bec tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:08.189413 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e9f10e96-020e-4824-8819-1b65bd2f3bec tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] [instance: 9e1de8ed-ee4e-40d3-9f22-3560b08031b4] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:08.195596 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e9f10e96-020e-4824-8819-1b65bd2f3bec tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:08.196080 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e9f10e96-020e-4824-8819-1b65bd2f3bec tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:08.196511 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e9f10e96-020e-4824-8819-1b65bd2f3bec tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:08.197244 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e9f10e96-020e-4824-8819-1b65bd2f3bec tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:08.197692 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e9f10e96-020e-4824-8819-1b65bd2f3bec tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:08.198629 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e9f10e96-020e-4824-8819-1b65bd2f3bec tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:08.336723 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=8 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:08.407840 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-911dbd43-2372-44f5-9ae1-554b3d8c213d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:08.415613 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-911dbd43-2372-44f5-9ae1-554b3d8c213d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879" status: 200 len: 1266 microversion: 2.1 time: 0.426392 Sep 06 22:49:08.416207 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 385/777] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:07 2022] GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879 => generated 1266 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:08.421211 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6f3f8cbe-e98c-4377-95ef-eec711d14a22 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:08.421701 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6f3f8cbe-e98c-4377-95ef-eec711d14a22 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:08.427987 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f3f8cbe-e98c-4377-95ef-eec711d14a22 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:08.428468 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f3f8cbe-e98c-4377-95ef-eec711d14a22 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:08.429313 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f3f8cbe-e98c-4377-95ef-eec711d14a22 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:08.430460 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f3f8cbe-e98c-4377-95ef-eec711d14a22 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:08.430968 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f3f8cbe-e98c-4377-95ef-eec711d14a22 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:08.431428 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6f3f8cbe-e98c-4377-95ef-eec711d14a22 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:08.556086 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e9f10e96-020e-4824-8819-1b65bd2f3bec tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5593dc049144447859a48e458717295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3e57c72cec4c128a09749da5a90a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:08.565682 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e9f10e96-020e-4824-8819-1b65bd2f3bec tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] 10.222.0.39 "GET /compute/v2.1/servers/9e1de8ed-ee4e-40d3-9f22-3560b08031b4" status: 200 len: 1496 microversion: 2.1 time: 0.383121 Sep 06 22:49:08.566262 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 393/778] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:08 2022] GET /compute/v2.1/servers/9e1de8ed-ee4e-40d3-9f22-3560b08031b4 => generated 1496 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:08.688460 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6f3f8cbe-e98c-4377-95ef-eec711d14a22 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5/os-volume_attachments/8de50623-4d71-42c9-b384-08c86768df4e" status: 202 len: 0 microversion: 2.20 time: 0.270996 Sep 06 22:49:08.689583 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 386/779] 10.222.0.39 () {60 vars in 1457 bytes} [Tue Sep 6 22:49:08 2022] DELETE /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5/os-volume_attachments/8de50623-4d71-42c9-b384-08c86768df4e => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 22:49:08.767461 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-72316cf4-3dfe-4fa5-a6fb-c5856fbf6167 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:49:08.768049 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-72316cf4-3dfe-4fa5-a6fb-c5856fbf6167 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:08.773967 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-72316cf4-3dfe-4fa5-a6fb-c5856fbf6167 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:08.774650 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-72316cf4-3dfe-4fa5-a6fb-c5856fbf6167 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:08.775254 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-72316cf4-3dfe-4fa5-a6fb-c5856fbf6167 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:08.776408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-72316cf4-3dfe-4fa5-a6fb-c5856fbf6167 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:08.777897 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-72316cf4-3dfe-4fa5-a6fb-c5856fbf6167 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:08.778322 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-72316cf4-3dfe-4fa5-a6fb-c5856fbf6167 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:08.850442 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-72316cf4-3dfe-4fa5-a6fb-c5856fbf6167 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127087) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 06 22:49:08.905014 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:08.948407 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-72316cf4-3dfe-4fa5-a6fb-c5856fbf6167 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "POST /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5/action" status: 202 len: 0 microversion: 2.20 time: 0.184123 Sep 06 22:49:08.949811 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 394/780] 10.222.0.39 () {62 vars in 1319 bytes} [Tue Sep 6 22:49:08 2022] POST /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 22:49:08.970202 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a1a26b6c-d8f8-406e-805b-0cc1c120debc tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:08.972317 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a1a26b6c-d8f8-406e-805b-0cc1c120debc tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:08.982488 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:08.989943 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a1a26b6c-d8f8-406e-805b-0cc1c120debc tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:08.990655 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a1a26b6c-d8f8-406e-805b-0cc1c120debc tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:08.990933 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a1a26b6c-d8f8-406e-805b-0cc1c120debc tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:08.994131 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a1a26b6c-d8f8-406e-805b-0cc1c120debc tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:08.994603 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a1a26b6c-d8f8-406e-805b-0cc1c120debc tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:08.996031 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a1a26b6c-d8f8-406e-805b-0cc1c120debc tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:09.072489 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-febaf322-3cc3-4863-b99e-e6842a0f1b11 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:09.074276 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-febaf322-3cc3-4863-b99e-e6842a0f1b11 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] [instance: 9e1de8ed-ee4e-40d3-9f22-3560b08031b4] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:09.082924 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-febaf322-3cc3-4863-b99e-e6842a0f1b11 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:09.083581 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-febaf322-3cc3-4863-b99e-e6842a0f1b11 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:09.084207 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-febaf322-3cc3-4863-b99e-e6842a0f1b11 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:09.085687 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-febaf322-3cc3-4863-b99e-e6842a0f1b11 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:09.086364 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-febaf322-3cc3-4863-b99e-e6842a0f1b11 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:09.087109 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-febaf322-3cc3-4863-b99e-e6842a0f1b11 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:09.123790 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-febaf322-3cc3-4863-b99e-e6842a0f1b11 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] [instance: 9e1de8ed-ee4e-40d3-9f22-3560b08031b4] Going to try to terminate instance {{(pid=127087) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 22:49:09.245480 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:09.283493 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-febaf322-3cc3-4863-b99e-e6842a0f1b11 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9e1de8ed-ee4e-40d3-9f22-3560b08031b4" status: 204 len: 0 microversion: 2.1 time: 0.214660 Sep 06 22:49:09.284391 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 395/781] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Sep 6 22:49:09 2022] DELETE /compute/v2.1/servers/9e1de8ed-ee4e-40d3-9f22-3560b08031b4 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 22:49:09.297293 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a1a26b6c-d8f8-406e-805b-0cc1c120debc tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:09.299866 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-2b29ed78-2cc1-4f9b-b335-2a4dcfac869f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:09.301022 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-2b29ed78-2cc1-4f9b-b335-2a4dcfac869f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:09.308705 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a1a26b6c-d8f8-406e-805b-0cc1c120debc tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:09.310933 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a1a26b6c-d8f8-406e-805b-0cc1c120debc tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:09.312367 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a1a26b6c-d8f8-406e-805b-0cc1c120debc tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1673 microversion: 2.20 time: 0.358572 Sep 06 22:49:09.313388 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 387/782] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:49:08 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1673 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:49:09.319029 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e26cbb60-62a9-41b5-b769-6d0e359dff63 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:09.319626 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e26cbb60-62a9-41b5-b769-6d0e359dff63 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] [instance: 9e1de8ed-ee4e-40d3-9f22-3560b08031b4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:09.328354 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e26cbb60-62a9-41b5-b769-6d0e359dff63 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:09.329235 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e26cbb60-62a9-41b5-b769-6d0e359dff63 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:09.329828 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e26cbb60-62a9-41b5-b769-6d0e359dff63 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:09.330837 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2b29ed78-2cc1-4f9b-b335-2a4dcfac869f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:09.331172 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e26cbb60-62a9-41b5-b769-6d0e359dff63 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:09.331476 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2b29ed78-2cc1-4f9b-b335-2a4dcfac869f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:09.332010 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e26cbb60-62a9-41b5-b769-6d0e359dff63 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:09.332203 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2b29ed78-2cc1-4f9b-b335-2a4dcfac869f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:09.332842 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e26cbb60-62a9-41b5-b769-6d0e359dff63 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:09.333077 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2b29ed78-2cc1-4f9b-b335-2a4dcfac869f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:09.333597 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2b29ed78-2cc1-4f9b-b335-2a4dcfac869f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:09.334082 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2b29ed78-2cc1-4f9b-b335-2a4dcfac869f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:09.586301 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-2b29ed78-2cc1-4f9b-b335-2a4dcfac869f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:09.591162 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e26cbb60-62a9-41b5-b769-6d0e359dff63 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5593dc049144447859a48e458717295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3e57c72cec4c128a09749da5a90a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:09.595889 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-2b29ed78-2cc1-4f9b-b335-2a4dcfac869f tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1576 microversion: 2.1 time: 0.309985 Sep 06 22:49:09.596796 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 396/783] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:09 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1576 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:09.602358 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e26cbb60-62a9-41b5-b769-6d0e359dff63 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] 10.222.0.39 "GET /compute/v2.1/servers/9e1de8ed-ee4e-40d3-9f22-3560b08031b4" status: 200 len: 1502 microversion: 2.1 time: 0.287644 Sep 06 22:49:09.602646 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-8b8f4f35-77ae-4a66-8b35-2c6838e398ad tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:09.602940 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 388/784] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:09 2022] GET /compute/v2.1/servers/9e1de8ed-ee4e-40d3-9f22-3560b08031b4 => generated 1502 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:09.603710 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-8b8f4f35-77ae-4a66-8b35-2c6838e398ad tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 5acd0d35-4bad-4c55-853d-767fec050879] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:09.615163 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8b8f4f35-77ae-4a66-8b35-2c6838e398ad tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:09.617354 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8b8f4f35-77ae-4a66-8b35-2c6838e398ad tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:09.619352 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8b8f4f35-77ae-4a66-8b35-2c6838e398ad tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:09.624003 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8b8f4f35-77ae-4a66-8b35-2c6838e398ad tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:09.625268 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8b8f4f35-77ae-4a66-8b35-2c6838e398ad tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:09.625922 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8b8f4f35-77ae-4a66-8b35-2c6838e398ad tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:09.826086 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-8b8f4f35-77ae-4a66-8b35-2c6838e398ad tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:09.838449 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-8b8f4f35-77ae-4a66-8b35-2c6838e398ad tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879" status: 200 len: 1266 microversion: 2.1 time: 0.240355 Sep 06 22:49:09.839175 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 397/785] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:09 2022] GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879 => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:10.342223 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8343be9c-b95d-4d17-be9a-f1ae50a60e79 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:10.343764 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8343be9c-b95d-4d17-be9a-f1ae50a60e79 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:10.350912 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8343be9c-b95d-4d17-be9a-f1ae50a60e79 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:10.351665 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8343be9c-b95d-4d17-be9a-f1ae50a60e79 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:10.352269 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8343be9c-b95d-4d17-be9a-f1ae50a60e79 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:10.353348 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8343be9c-b95d-4d17-be9a-f1ae50a60e79 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:10.354126 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8343be9c-b95d-4d17-be9a-f1ae50a60e79 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:10.355842 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8343be9c-b95d-4d17-be9a-f1ae50a60e79 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:10.621231 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-00541328-4b5d-4f13-9847-b1381b58f671 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:10.623367 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-00541328-4b5d-4f13-9847-b1381b58f671 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:10.629497 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-00541328-4b5d-4f13-9847-b1381b58f671 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:10.630180 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-00541328-4b5d-4f13-9847-b1381b58f671 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:10.631544 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-00541328-4b5d-4f13-9847-b1381b58f671 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:10.634520 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-00541328-4b5d-4f13-9847-b1381b58f671 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:10.634985 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-00541328-4b5d-4f13-9847-b1381b58f671 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:10.635985 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-00541328-4b5d-4f13-9847-b1381b58f671 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:10.676693 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8343be9c-b95d-4d17-be9a-f1ae50a60e79 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:10.689111 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8343be9c-b95d-4d17-be9a-f1ae50a60e79 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:10.690942 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8343be9c-b95d-4d17-be9a-f1ae50a60e79 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:10.692419 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8343be9c-b95d-4d17-be9a-f1ae50a60e79 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1673 microversion: 2.20 time: 0.356103 Sep 06 22:49:10.706561 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 389/786] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:49:10 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1673 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:49:10.722177 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d3fe1277-358c-4e79-846a-b79ac371cf51 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:10.723284 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d3fe1277-358c-4e79-846a-b79ac371cf51 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] [instance: 9e1de8ed-ee4e-40d3-9f22-3560b08031b4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:10.731789 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d3fe1277-358c-4e79-846a-b79ac371cf51 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:10.732551 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d3fe1277-358c-4e79-846a-b79ac371cf51 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:10.733231 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d3fe1277-358c-4e79-846a-b79ac371cf51 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:10.734174 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d3fe1277-358c-4e79-846a-b79ac371cf51 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:10.734851 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d3fe1277-358c-4e79-846a-b79ac371cf51 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:10.735491 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d3fe1277-358c-4e79-846a-b79ac371cf51 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:11.128046 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-00541328-4b5d-4f13-9847-b1381b58f671 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:11.136401 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-00541328-4b5d-4f13-9847-b1381b58f671 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1576 microversion: 2.1 time: 0.520440 Sep 06 22:49:11.137536 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 398/787] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:10 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1576 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:49:11.143013 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-225f8ba5-965a-4b57-b2da-1734a80ae927 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:11.143802 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-225f8ba5-965a-4b57-b2da-1734a80ae927 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 5acd0d35-4bad-4c55-853d-767fec050879] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:11.150174 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-225f8ba5-965a-4b57-b2da-1734a80ae927 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:11.151049 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-225f8ba5-965a-4b57-b2da-1734a80ae927 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:11.151892 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-225f8ba5-965a-4b57-b2da-1734a80ae927 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:11.152777 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-225f8ba5-965a-4b57-b2da-1734a80ae927 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:11.153381 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-225f8ba5-965a-4b57-b2da-1734a80ae927 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:11.155081 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-225f8ba5-965a-4b57-b2da-1734a80ae927 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:11.191410 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d3fe1277-358c-4e79-846a-b79ac371cf51 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5593dc049144447859a48e458717295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3e57c72cec4c128a09749da5a90a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:11.200656 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d3fe1277-358c-4e79-846a-b79ac371cf51 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] 10.222.0.39 "GET /compute/v2.1/servers/9e1de8ed-ee4e-40d3-9f22-3560b08031b4" status: 200 len: 1502 microversion: 2.1 time: 0.482970 Sep 06 22:49:11.201367 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 390/788] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:10 2022] GET /compute/v2.1/servers/9e1de8ed-ee4e-40d3-9f22-3560b08031b4 => generated 1502 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:11.566100 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-225f8ba5-965a-4b57-b2da-1734a80ae927 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:11.574308 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-225f8ba5-965a-4b57-b2da-1734a80ae927 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879" status: 200 len: 1266 microversion: 2.1 time: 0.435531 Sep 06 22:49:11.574903 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 399/789] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:11 2022] GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879 => generated 1266 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:11.725585 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-cd4fb904-9ed5-416a-a108-ecf2d8c2741c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:11.726309 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-cd4fb904-9ed5-416a-a108-ecf2d8c2741c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:11.734177 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cd4fb904-9ed5-416a-a108-ecf2d8c2741c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:11.734672 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cd4fb904-9ed5-416a-a108-ecf2d8c2741c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:11.735109 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cd4fb904-9ed5-416a-a108-ecf2d8c2741c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:11.735809 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cd4fb904-9ed5-416a-a108-ecf2d8c2741c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:11.736260 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cd4fb904-9ed5-416a-a108-ecf2d8c2741c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:11.736714 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cd4fb904-9ed5-416a-a108-ecf2d8c2741c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:12.164203 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-c25cd031-e310-4830-9892-33f3e66220ec tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:12.165381 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-c25cd031-e310-4830-9892-33f3e66220ec tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:12.176726 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c25cd031-e310-4830-9892-33f3e66220ec tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:12.177384 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c25cd031-e310-4830-9892-33f3e66220ec tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:12.178286 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c25cd031-e310-4830-9892-33f3e66220ec tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:12.181261 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c25cd031-e310-4830-9892-33f3e66220ec tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:12.182096 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c25cd031-e310-4830-9892-33f3e66220ec tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:12.183405 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c25cd031-e310-4830-9892-33f3e66220ec tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:12.201908 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-cd4fb904-9ed5-416a-a108-ecf2d8c2741c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:12.212531 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-cd4fb904-9ed5-416a-a108-ecf2d8c2741c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:12.214663 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-cd4fb904-9ed5-416a-a108-ecf2d8c2741c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:12.216435 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-cd4fb904-9ed5-416a-a108-ecf2d8c2741c tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1731 microversion: 2.20 time: 0.494884 Sep 06 22:49:12.217759 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 391/790] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:49:11 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1731 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:49:12.242462 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1681ec87-ae81-4ffd-92d0-861e267e4987 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:12.243090 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1681ec87-ae81-4ffd-92d0-861e267e4987 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] [instance: 9e1de8ed-ee4e-40d3-9f22-3560b08031b4] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:12.268740 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1681ec87-ae81-4ffd-92d0-861e267e4987 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:12.269746 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1681ec87-ae81-4ffd-92d0-861e267e4987 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:12.270446 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1681ec87-ae81-4ffd-92d0-861e267e4987 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:12.271582 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1681ec87-ae81-4ffd-92d0-861e267e4987 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:12.273975 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1681ec87-ae81-4ffd-92d0-861e267e4987 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:12.274695 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1681ec87-ae81-4ffd-92d0-861e267e4987 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:12.284296 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:12.426388 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1681ec87-ae81-4ffd-92d0-861e267e4987 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5593dc049144447859a48e458717295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3e57c72cec4c128a09749da5a90a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:12.439770 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1681ec87-ae81-4ffd-92d0-861e267e4987 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] 10.222.0.39 "GET /compute/v2.1/servers/9e1de8ed-ee4e-40d3-9f22-3560b08031b4" status: 200 len: 1460 microversion: 2.1 time: 0.219912 Sep 06 22:49:12.440353 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 392/791] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:12 2022] GET /compute/v2.1/servers/9e1de8ed-ee4e-40d3-9f22-3560b08031b4 => generated 1460 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:49:12.452985 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-f5578860-29e3-4c22-92e7-fd1e7b6fa9ec req-8840cae1-3c05-458e-98d7-4e17bb3fa8ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e1de8ed-ee4e-40d3-9f22-3560b08031b4", "name": "network-vif-deleted", "tag": "6e1d28d1-0fb1-4f1d-ace2-687e1ba9eb83"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:49:12.466040 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-f5578860-29e3-4c22-92e7-fd1e7b6fa9ec req-8840cae1-3c05-458e-98d7-4e17bb3fa8ac service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:12.472577 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-f5578860-29e3-4c22-92e7-fd1e7b6fa9ec req-8840cae1-3c05-458e-98d7-4e17bb3fa8ac service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:12.473010 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-f5578860-29e3-4c22-92e7-fd1e7b6fa9ec req-8840cae1-3c05-458e-98d7-4e17bb3fa8ac service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:12.487887 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-f5578860-29e3-4c22-92e7-fd1e7b6fa9ec req-8840cae1-3c05-458e-98d7-4e17bb3fa8ac service nova] Creating event network-vif-deleted:6e1d28d1-0fb1-4f1d-ace2-687e1ba9eb83 for instance 9e1de8ed-ee4e-40d3-9f22-3560b08031b4 on hv-cinder-85220 Sep 06 22:49:12.496989 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-f5578860-29e3-4c22-92e7-fd1e7b6fa9ec req-8840cae1-3c05-458e-98d7-4e17bb3fa8ac service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051872 Sep 06 22:49:12.498155 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 393/792] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:49:12.527202 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-c25cd031-e310-4830-9892-33f3e66220ec tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:12.537460 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-c25cd031-e310-4830-9892-33f3e66220ec tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1576 microversion: 2.1 time: 0.378979 Sep 06 22:49:12.538041 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 400/793] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:12 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1576 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:49:12.599701 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-aa05781a-5e72-4f3f-9456-a6d1571910d0 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:12.600687 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-aa05781a-5e72-4f3f-9456-a6d1571910d0 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 5acd0d35-4bad-4c55-853d-767fec050879] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:12.615633 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aa05781a-5e72-4f3f-9456-a6d1571910d0 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:12.616182 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aa05781a-5e72-4f3f-9456-a6d1571910d0 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:12.616618 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aa05781a-5e72-4f3f-9456-a6d1571910d0 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:12.617432 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aa05781a-5e72-4f3f-9456-a6d1571910d0 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:12.617881 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aa05781a-5e72-4f3f-9456-a6d1571910d0 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:12.618452 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-aa05781a-5e72-4f3f-9456-a6d1571910d0 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:12.805062 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-aa05781a-5e72-4f3f-9456-a6d1571910d0 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:12.813609 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-aa05781a-5e72-4f3f-9456-a6d1571910d0 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879" status: 200 len: 1266 microversion: 2.1 time: 0.218427 Sep 06 22:49:12.830346 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 394/794] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:12 2022] GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879 => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:13.247270 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ff16a017-61ff-4347-a995-982421e919aa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:13.248791 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ff16a017-61ff-4347-a995-982421e919aa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:13.255168 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ff16a017-61ff-4347-a995-982421e919aa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:13.255857 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ff16a017-61ff-4347-a995-982421e919aa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:13.256488 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ff16a017-61ff-4347-a995-982421e919aa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:13.257235 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ff16a017-61ff-4347-a995-982421e919aa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:13.257753 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ff16a017-61ff-4347-a995-982421e919aa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:13.258271 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ff16a017-61ff-4347-a995-982421e919aa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:13.425478 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ff16a017-61ff-4347-a995-982421e919aa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:13.434802 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ff16a017-61ff-4347-a995-982421e919aa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:13.436908 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ff16a017-61ff-4347-a995-982421e919aa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:13.438092 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ff16a017-61ff-4347-a995-982421e919aa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1731 microversion: 2.20 time: 0.195360 Sep 06 22:49:13.438650 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 401/795] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:49:13 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1731 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:49:13.463425 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-655a4658-3046-45ae-90eb-a8f19bbd092a tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:13.464067 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-655a4658-3046-45ae-90eb-a8f19bbd092a tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] [instance: 9e1de8ed-ee4e-40d3-9f22-3560b08031b4] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:13.470618 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-655a4658-3046-45ae-90eb-a8f19bbd092a tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:13.471096 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-655a4658-3046-45ae-90eb-a8f19bbd092a tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:13.471723 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-655a4658-3046-45ae-90eb-a8f19bbd092a tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:13.472406 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-655a4658-3046-45ae-90eb-a8f19bbd092a tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:13.472876 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-655a4658-3046-45ae-90eb-a8f19bbd092a tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:13.473292 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-655a4658-3046-45ae-90eb-a8f19bbd092a tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:13.487105 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-655a4658-3046-45ae-90eb-a8f19bbd092a tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] HTTP exception thrown: Instance 9e1de8ed-ee4e-40d3-9f22-3560b08031b4 could not be found. Sep 06 22:49:13.488739 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-655a4658-3046-45ae-90eb-a8f19bbd092a tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Request method failure captured: Sep 06 22:49:13.488739 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: request: GET /compute/v2.1/servers/9e1de8ed-ee4e-40d3-9f22-3560b08031b4 HTTP/1.1 Sep 06 22:49:13.488739 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept: application/json Sep 06 22:49:13.488739 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Sep 06 22:49:13.488739 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Connection: close Sep 06 22:49:13.488739 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Length: 0 Sep 06 22:49:13.488739 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Type: application/json Sep 06 22:49:13.488739 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Host: 10.222.0.39 Sep 06 22:49:13.488739 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Sep 06 22:49:13.488739 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.12 Sep 06 22:49:13.488739 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABjF85VcLSdc79Exi4mKn_ISoOQ0IjCyK2LhqY563HKfPT5h7hHLy3e8pMqh-inyyoS7rjAhfIbf2eRxvwPlFpTZZS-v6PBEYR1M2ws2jgjrqSw7-UPMv0PbykZQzX70UaMNKRBPpSLXblBdUMDSNi9OrKx-XP7m2gJ0YWeWiMWf7mactY Sep 06 22:49:13.488739 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Sep 06 22:49:13.488739 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Sep 06 22:49:13.488739 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Sep 06 22:49:13.488739 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Sep 06 22:49:13.488739 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Sep 06 22:49:13.488739 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Sep 06 22:49:13.488739 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Id: 9b3e57c72cec4c128a09749da5a90a5d Sep 06 22:49:13.488739 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-VolumesActionsTest-1712756567 Sep 06 22:49:13.488739 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Role: reader,member Sep 06 22:49:13.488739 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Sep 06 22:49:13.490408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9b3e57c72cec4c128a09749da5a90a5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9b3e57c72cec4c128a09749da5a90a5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9b3e57c72cec4c128a09749da5a90a5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9b3e57c72cec4c128a09749da5a90a5d"}]}] Sep 06 22:49:13.490408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-VolumesActionsTest-1712756567 Sep 06 22:49:13.490408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 9b3e57c72cec4c128a09749da5a90a5d Sep 06 22:49:13.490408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-VolumesActionsTest-1712756567 Sep 06 22:49:13.490408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User: tempest-VolumesActionsTest-1712756567-project Sep 06 22:49:13.490408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Sep 06 22:49:13.490408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Sep 06 22:49:13.490408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Id: e5593dc049144447859a48e458717295 Sep 06 22:49:13.490408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-VolumesActionsTest-1712756567-project Sep 06 22:49:13.490408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: method: > Sep 06 22:49:13.490408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: exception: Instance 9e1de8ed-ee4e-40d3-9f22-3560b08031b4 could not be found. Sep 06 22:49:13.490408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: action_args: {'id': '9e1de8ed-ee4e-40d3-9f22-3560b08031b4'} Sep 06 22:49:13.491766 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:49:13.491766 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:13.491766 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:49:13.491766 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:49:13.491766 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:49:13.491766 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:49:13.491766 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:49:13.491766 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:49:13.491766 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:49:13.491766 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:49:13.491766 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e1de8ed-ee4e-40d3-9f22-3560b08031b4 could not be found. Sep 06 22:49:13.491766 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:13.491766 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:49:13.491766 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:13.491766 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:13.491766 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:49:13.491766 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:49:13.491766 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:49:13.491766 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:49:13.491766 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:49:13.493275 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:49:13.493275 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 22:49:13.493275 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 22:49:13.493275 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:49:13.493275 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:49:13.493275 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:49:13.493275 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:49:13.493275 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e1de8ed-ee4e-40d3-9f22-3560b08031b4 could not be found. Sep 06 22:49:13.493275 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:13.493275 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:49:13.493275 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:13.493275 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:13.493275 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:49:13.493275 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:49:13.493275 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:49:13.493275 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:49:13.493275 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e1de8ed-ee4e-40d3-9f22-3560b08031b4 could not be found. Sep 06 22:49:13.493275 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:13.494473 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-655a4658-3046-45ae-90eb-a8f19bbd092a tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Returning 404 to user: Instance 9e1de8ed-ee4e-40d3-9f22-3560b08031b4 could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:49:13.494473 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-655a4658-3046-45ae-90eb-a8f19bbd092a tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] 10.222.0.39 "GET /compute/v2.1/servers/9e1de8ed-ee4e-40d3-9f22-3560b08031b4" status: 404 len: 111 microversion: 2.1 time: 0.030638 Sep 06 22:49:13.494473 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 402/796] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:13 2022] GET /compute/v2.1/servers/9e1de8ed-ee4e-40d3-9f22-3560b08031b4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 22:49:13.543829 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e3e445d5-ac97-4b64-8f5d-cddb5d9272b2 tempest-VolumesGetTestJSON-841329172 tempest-VolumesGetTestJSON-841329172-project] Action: 'create', calling method: .version_select at 0x7f9c5300be50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1710623941", "metadata": {"Type": "work"}}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:49:13.568596 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-cee135cf-de6a-4f74-b36d-3e8bb19ecaae tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:13.569230 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-cee135cf-de6a-4f74-b36d-3e8bb19ecaae tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:13.583134 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cee135cf-de6a-4f74-b36d-3e8bb19ecaae tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:13.583869 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cee135cf-de6a-4f74-b36d-3e8bb19ecaae tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:13.584297 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cee135cf-de6a-4f74-b36d-3e8bb19ecaae tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:13.585074 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cee135cf-de6a-4f74-b36d-3e8bb19ecaae tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:13.585680 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cee135cf-de6a-4f74-b36d-3e8bb19ecaae tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:13.586296 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-cee135cf-de6a-4f74-b36d-3e8bb19ecaae tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:13.817224 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-cee135cf-de6a-4f74-b36d-3e8bb19ecaae tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:13.829226 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-cee135cf-de6a-4f74-b36d-3e8bb19ecaae tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1576 microversion: 2.1 time: 0.264273 Sep 06 22:49:13.830037 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 403/797] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:13 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1576 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:13.864091 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-10b90e15-ee38-4589-9b0f-19dec598afec tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1462673863", "imageRef": "93326d5e-4826-431e-9ad1-6ee2d44e48d9", "flavorRef": "452", "networks": [{"uuid": "bb111489-5654-49b6-a948-e938c971cdc9"}]}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:49:14.008806 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.network.neutron [None req-10b90e15-ee38-4589-9b0f-19dec598afec tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] validate_networks() for [('bb111489-5654-49b6-a948-e938c971cdc9', None, None, None, None, None)] {{(pid=127087) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 22:49:14.041180 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e3e445d5-ac97-4b64-8f5d-cddb5d9272b2 tempest-VolumesGetTestJSON-841329172 tempest-VolumesGetTestJSON-841329172-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.622093 Sep 06 22:49:14.042792 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 395/798] 10.222.0.39 () {60 vars in 1156 bytes} [Tue Sep 6 22:49:13 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 625 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 06 22:49:14.068042 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ae9c041d-26a0-48b5-9599-40f6ad222a0d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:14.069028 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ae9c041d-26a0-48b5-9599-40f6ad222a0d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 5acd0d35-4bad-4c55-853d-767fec050879] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:14.085419 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ae9c041d-26a0-48b5-9599-40f6ad222a0d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:14.086594 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ae9c041d-26a0-48b5-9599-40f6ad222a0d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:14.090560 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ae9c041d-26a0-48b5-9599-40f6ad222a0d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:14.091639 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ae9c041d-26a0-48b5-9599-40f6ad222a0d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:14.092340 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ae9c041d-26a0-48b5-9599-40f6ad222a0d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:14.093034 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ae9c041d-26a0-48b5-9599-40f6ad222a0d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:14.497184 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ae9c041d-26a0-48b5-9599-40f6ad222a0d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:14.507719 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ae9c041d-26a0-48b5-9599-40f6ad222a0d tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879" status: 200 len: 1266 microversion: 2.1 time: 0.451145 Sep 06 22:49:14.529465 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 396/799] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:14 2022] GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879 => generated 1266 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:14.542666 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0261acb8-b746-48fe-9442-030bf057bace tempest-VolumesGetTestJSON-841329172 tempest-VolumesGetTestJSON-841329172-project] Calling method '.version_select at 0x7f9c53037160>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:14.640970 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0261acb8-b746-48fe-9442-030bf057bace tempest-VolumesGetTestJSON-841329172 tempest-VolumesGetTestJSON-841329172-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/7138a0de-d835-478b-a542-7577386892fd" status: 200 len: 354 microversion: 2.1 time: 0.109335 Sep 06 22:49:14.641876 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 397/800] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Sep 6 22:49:14 2022] GET /compute/v2.1/os-volumes/7138a0de-d835-478b-a542-7577386892fd => generated 354 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:49:14.654946 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-73369515-30cd-4519-aa4c-5de615b3201d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:14.655968 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-73369515-30cd-4519-aa4c-5de615b3201d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:14.665609 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-73369515-30cd-4519-aa4c-5de615b3201d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:14.668745 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-73369515-30cd-4519-aa4c-5de615b3201d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:14.672489 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-73369515-30cd-4519-aa4c-5de615b3201d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:14.673477 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-73369515-30cd-4519-aa4c-5de615b3201d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:14.674083 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-73369515-30cd-4519-aa4c-5de615b3201d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:14.674655 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-73369515-30cd-4519-aa4c-5de615b3201d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:14.740418 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-10b90e15-ee38-4589-9b0f-19dec598afec tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Flavor limits 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 22:49:14.741587 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-10b90e15-ee38-4589-9b0f-19dec598afec tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Image limits 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 22:49:14.742227 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-10b90e15-ee38-4589-9b0f-19dec598afec tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Flavor pref 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 22:49:14.742858 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-10b90e15-ee38-4589-9b0f-19dec598afec tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Image pref 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 22:49:14.743509 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-10b90e15-ee38-4589-9b0f-19dec598afec tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 22:49:14.774976 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-10b90e15-ee38-4589-9b0f-19dec598afec tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:14.777920 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-10b90e15-ee38-4589-9b0f-19dec598afec tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:14.779375 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-10b90e15-ee38-4589-9b0f-19dec598afec tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:14.781173 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-10b90e15-ee38-4589-9b0f-19dec598afec tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:14.782500 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-10b90e15-ee38-4589-9b0f-19dec598afec tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:14.783754 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-10b90e15-ee38-4589-9b0f-19dec598afec tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:14.824741 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-10b90e15-ee38-4589-9b0f-19dec598afec tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Getting quotas for project 9b3e57c72cec4c128a09749da5a90a5d. Resources: {'instances', 'ram', 'cores'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 22:49:14.830412 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-10b90e15-ee38-4589-9b0f-19dec598afec tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Getting quotas for user e5593dc049144447859a48e458717295 and project 9b3e57c72cec4c128a09749da5a90a5d. Resources: {'instances', 'ram', 'cores'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 22:49:14.849922 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-10b90e15-ee38-4589-9b0f-19dec598afec tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Going to run 1 instances... {{(pid=127087) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 22:49:14.852844 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-10b90e15-ee38-4589-9b0f-19dec598afec tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] [instance: e839f6fc-d10f-4c98-b6f4-9b16ed202d66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='93326d5e-4826-431e-9ad1-6ee2d44e48d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 22:49:14.911743 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-10b90e15-ee38-4589-9b0f-19dec598afec tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.079779 Sep 06 22:49:14.913085 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 404/801] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Sep 6 22:49:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 22:49:14.919256 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-26476523-8a7f-42d4-acd2-c3aaec547781 tempest-VolumesGetTestJSON-841329172 tempest-VolumesGetTestJSON-841329172-project] Calling method '.version_select at 0x7f9c52fe7dc0>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:14.977420 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-73369515-30cd-4519-aa4c-5de615b3201d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:14.989185 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-73369515-30cd-4519-aa4c-5de615b3201d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:14.991537 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-73369515-30cd-4519-aa4c-5de615b3201d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:14.993041 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-73369515-30cd-4519-aa4c-5de615b3201d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1731 microversion: 2.20 time: 0.350037 Sep 06 22:49:14.994174 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 398/802] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:49:14 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1731 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:49:15.000297 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-52ca7c7a-4458-43d1-b73c-4bc91dd49af4 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:15.001405 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-52ca7c7a-4458-43d1-b73c-4bc91dd49af4 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:15.008298 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-52ca7c7a-4458-43d1-b73c-4bc91dd49af4 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:15.009565 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-52ca7c7a-4458-43d1-b73c-4bc91dd49af4 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:15.012124 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-52ca7c7a-4458-43d1-b73c-4bc91dd49af4 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:15.013677 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-52ca7c7a-4458-43d1-b73c-4bc91dd49af4 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:15.014346 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-52ca7c7a-4458-43d1-b73c-4bc91dd49af4 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:15.014846 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-52ca7c7a-4458-43d1-b73c-4bc91dd49af4 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:15.031064 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-26476523-8a7f-42d4-acd2-c3aaec547781 tempest-VolumesGetTestJSON-841329172 tempest-VolumesGetTestJSON-841329172-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/7138a0de-d835-478b-a542-7577386892fd" status: 200 len: 354 microversion: 2.1 time: 0.116166 Sep 06 22:49:15.031928 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 405/803] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Sep 6 22:49:14 2022] GET /compute/v2.1/os-volumes/7138a0de-d835-478b-a542-7577386892fd => generated 354 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:49:15.047309 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-695b7162-7c5e-496c-83b7-179c004dfad1 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:15.048108 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-695b7162-7c5e-496c-83b7-179c004dfad1 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] [instance: e839f6fc-d10f-4c98-b6f4-9b16ed202d66] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:15.166683 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-695b7162-7c5e-496c-83b7-179c004dfad1 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5593dc049144447859a48e458717295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3e57c72cec4c128a09749da5a90a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:15.179705 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-695b7162-7c5e-496c-83b7-179c004dfad1 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] 10.222.0.39 "GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66" status: 200 len: 1214 microversion: 2.1 time: 0.141246 Sep 06 22:49:15.181171 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 406/804] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:15 2022] GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66 => generated 1214 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:15.188666 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e1744971-3546-4f82-ad8a-01d6368b47f5 tempest-VolumesGetTestJSON-841329172 tempest-VolumesGetTestJSON-841329172-project] Calling method '.version_select at 0x7f9c52fe70d0>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:15.318306 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-52ca7c7a-4458-43d1-b73c-4bc91dd49af4 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:15.325937 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e1744971-3546-4f82-ad8a-01d6368b47f5 tempest-VolumesGetTestJSON-841329172 tempest-VolumesGetTestJSON-841329172-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/7138a0de-d835-478b-a542-7577386892fd" status: 202 len: 0 microversion: 2.1 time: 0.143486 Sep 06 22:49:15.326944 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 407/805] 10.222.0.39 () {58 vars in 1248 bytes} [Tue Sep 6 22:49:15 2022] DELETE /compute/v2.1/os-volumes/7138a0de-d835-478b-a542-7577386892fd => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 22:49:15.336558 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-edb6004a-a31f-4d0d-9705-13cf3f4e8388 tempest-VolumesGetTestJSON-841329172 tempest-VolumesGetTestJSON-841329172-project] Calling method '.version_select at 0x7f9c4fb92a60>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:15.346797 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-52ca7c7a-4458-43d1-b73c-4bc91dd49af4 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1576 microversion: 2.1 time: 0.347540 Sep 06 22:49:15.347746 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 399/806] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:14 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1576 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:15.431284 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-edb6004a-a31f-4d0d-9705-13cf3f4e8388 tempest-VolumesGetTestJSON-841329172 tempest-VolumesGetTestJSON-841329172-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/7138a0de-d835-478b-a542-7577386892fd" status: 200 len: 353 microversion: 2.1 time: 0.099734 Sep 06 22:49:15.433007 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 408/807] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Sep 6 22:49:15 2022] GET /compute/v2.1/os-volumes/7138a0de-d835-478b-a542-7577386892fd => generated 353 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 22:49:15.535093 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1f862ba1-c199-4a90-aa23-76de136a0c32 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:15.535701 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1f862ba1-c199-4a90-aa23-76de136a0c32 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 5acd0d35-4bad-4c55-853d-767fec050879] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:15.542183 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1f862ba1-c199-4a90-aa23-76de136a0c32 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:15.543188 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1f862ba1-c199-4a90-aa23-76de136a0c32 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:15.543864 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1f862ba1-c199-4a90-aa23-76de136a0c32 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:15.544986 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1f862ba1-c199-4a90-aa23-76de136a0c32 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:15.545798 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1f862ba1-c199-4a90-aa23-76de136a0c32 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:15.546332 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1f862ba1-c199-4a90-aa23-76de136a0c32 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:15.723061 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1f862ba1-c199-4a90-aa23-76de136a0c32 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:15.732811 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1f862ba1-c199-4a90-aa23-76de136a0c32 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879" status: 200 len: 1266 microversion: 2.1 time: 0.200428 Sep 06 22:49:15.733415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 400/808] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:15 2022] GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879 => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:15.970517 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-386baa82-05ba-4e49-bbaf-c8e0ed60918d req-df5b1389-6443-44ed-aa55-57c2a81e795e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5acd0d35-4bad-4c55-853d-767fec050879", "name": "network-vif-plugged", "status": "completed", "tag": "5283334a-d586-42df-ac4b-7eae8c83bfd3"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:49:15.988946 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-386baa82-05ba-4e49-bbaf-c8e0ed60918d req-df5b1389-6443-44ed-aa55-57c2a81e795e service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:15.989662 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-386baa82-05ba-4e49-bbaf-c8e0ed60918d req-df5b1389-6443-44ed-aa55-57c2a81e795e service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:15.990084 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-386baa82-05ba-4e49-bbaf-c8e0ed60918d req-df5b1389-6443-44ed-aa55-57c2a81e795e service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:16.002700 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-386baa82-05ba-4e49-bbaf-c8e0ed60918d req-df5b1389-6443-44ed-aa55-57c2a81e795e service nova] Creating event network-vif-plugged:5283334a-d586-42df-ac4b-7eae8c83bfd3 for instance 5acd0d35-4bad-4c55-853d-767fec050879 on hv-cinder-85220 Sep 06 22:49:16.011131 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-386baa82-05ba-4e49-bbaf-c8e0ed60918d req-df5b1389-6443-44ed-aa55-57c2a81e795e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044196 Sep 06 22:49:16.012015 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 409/809] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:49:16.020779 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9008fe23-4a0c-48bf-b34d-88c57bf2ed58 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:16.021732 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9008fe23-4a0c-48bf-b34d-88c57bf2ed58 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:16.031743 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9008fe23-4a0c-48bf-b34d-88c57bf2ed58 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:16.032504 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9008fe23-4a0c-48bf-b34d-88c57bf2ed58 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:16.033211 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9008fe23-4a0c-48bf-b34d-88c57bf2ed58 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:16.034677 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9008fe23-4a0c-48bf-b34d-88c57bf2ed58 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:16.037110 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9008fe23-4a0c-48bf-b34d-88c57bf2ed58 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:16.037660 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9008fe23-4a0c-48bf-b34d-88c57bf2ed58 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:16.198848 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9008fe23-4a0c-48bf-b34d-88c57bf2ed58 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:16.204505 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-1f4d967a-8034-475f-910d-900dc6804207 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:16.205256 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-1f4d967a-8034-475f-910d-900dc6804207 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] [instance: e839f6fc-d10f-4c98-b6f4-9b16ed202d66] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:16.207183 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9008fe23-4a0c-48bf-b34d-88c57bf2ed58 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:16.208693 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9008fe23-4a0c-48bf-b34d-88c57bf2ed58 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:16.210055 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9008fe23-4a0c-48bf-b34d-88c57bf2ed58 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1731 microversion: 2.20 time: 0.193275 Sep 06 22:49:16.210938 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 401/810] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:49:16 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1731 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:49:16.212047 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1f4d967a-8034-475f-910d-900dc6804207 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:16.212862 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1f4d967a-8034-475f-910d-900dc6804207 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:16.214106 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1f4d967a-8034-475f-910d-900dc6804207 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:16.215152 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1f4d967a-8034-475f-910d-900dc6804207 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:16.215760 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1f4d967a-8034-475f-910d-900dc6804207 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:16.216482 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1f4d967a-8034-475f-910d-900dc6804207 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:16.297447 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-1f4d967a-8034-475f-910d-900dc6804207 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5593dc049144447859a48e458717295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3e57c72cec4c128a09749da5a90a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:16.307005 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-1f4d967a-8034-475f-910d-900dc6804207 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] 10.222.0.39 "GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66" status: 200 len: 1218 microversion: 2.1 time: 0.106582 Sep 06 22:49:16.308648 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 410/811] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:16 2022] GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66 => generated 1218 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:16.376246 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-af291d7f-0cb9-47b0-8f94-fbab1e78fe2e tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:16.376870 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-af291d7f-0cb9-47b0-8f94-fbab1e78fe2e tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:16.382756 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af291d7f-0cb9-47b0-8f94-fbab1e78fe2e tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:16.383228 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af291d7f-0cb9-47b0-8f94-fbab1e78fe2e tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:16.383650 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af291d7f-0cb9-47b0-8f94-fbab1e78fe2e tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:16.384326 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af291d7f-0cb9-47b0-8f94-fbab1e78fe2e tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:16.384784 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af291d7f-0cb9-47b0-8f94-fbab1e78fe2e tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:16.385209 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-af291d7f-0cb9-47b0-8f94-fbab1e78fe2e tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:16.447252 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-0bf44c39-46a9-4b8b-ac96-7112a2fa077d tempest-VolumesGetTestJSON-841329172 tempest-VolumesGetTestJSON-841329172-project] Calling method '.version_select at 0x7f9c530031f0>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:16.487440 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-0bf44c39-46a9-4b8b-ac96-7112a2fa077d tempest-VolumesGetTestJSON-841329172 tempest-VolumesGetTestJSON-841329172-project] HTTP exception thrown: Volume 7138a0de-d835-478b-a542-7577386892fd could not be found. Sep 06 22:49:16.489845 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-0bf44c39-46a9-4b8b-ac96-7112a2fa077d tempest-VolumesGetTestJSON-841329172 tempest-VolumesGetTestJSON-841329172-project] Request method failure captured: Sep 06 22:49:16.489845 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: request: GET /compute/v2.1/os-volumes/7138a0de-d835-478b-a542-7577386892fd HTTP/1.1 Sep 06 22:49:16.489845 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept: application/json Sep 06 22:49:16.489845 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Sep 06 22:49:16.489845 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Connection: close Sep 06 22:49:16.489845 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Length: 0 Sep 06 22:49:16.489845 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Type: application/json Sep 06 22:49:16.489845 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Host: 10.222.0.39 Sep 06 22:49:16.489845 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Sep 06 22:49:16.489845 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.12 Sep 06 22:49:16.489845 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABjF85pHe3dk8t5P5dYcKTxPrMPamn0q7ShSjd7rYWt0tP0jOfhZc9biDehDlV2xBOP6zbMfJQvLkaCvkuy-MbzXMTQS9qnQZXRFQBY2kiSgKpOLYgQp18PnrZWij-pa7rfpczD1J8t1cxo-p2UVI2ZwmFVhQSU3aMc4R22r1vpU6Et0uk Sep 06 22:49:16.489845 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Sep 06 22:49:16.489845 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Sep 06 22:49:16.489845 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Sep 06 22:49:16.489845 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Sep 06 22:49:16.489845 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Sep 06 22:49:16.489845 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Sep 06 22:49:16.489845 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Id: 387afebc94bd43888a281e078e939b43 Sep 06 22:49:16.489845 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-VolumesGetTestJSON-841329172 Sep 06 22:49:16.489845 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Role: reader,member Sep 06 22:49:16.489845 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Sep 06 22:49:16.491181 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/387afebc94bd43888a281e078e939b43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_387afebc94bd43888a281e078e939b43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/387afebc94bd43888a281e078e939b43"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/387afebc94bd43888a281e078e939b43"}]}] Sep 06 22:49:16.491181 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-VolumesGetTestJSON-841329172 Sep 06 22:49:16.491181 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 387afebc94bd43888a281e078e939b43 Sep 06 22:49:16.491181 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-VolumesGetTestJSON-841329172 Sep 06 22:49:16.491181 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User: tempest-VolumesGetTestJSON-841329172-project Sep 06 22:49:16.491181 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Sep 06 22:49:16.491181 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Sep 06 22:49:16.491181 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Id: 5bd22845b8094127880995c1ef4e720e Sep 06 22:49:16.491181 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-VolumesGetTestJSON-841329172-project Sep 06 22:49:16.491181 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: method: Sep 06 22:49:16.491181 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: exception: Volume 7138a0de-d835-478b-a542-7577386892fd could not be found. Sep 06 22:49:16.491181 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: action_args: {'id': '7138a0de-d835-478b-a542-7577386892fd'} Sep 06 22:49:16.491181 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:49:16.491992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:16.491992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 22:49:16.491992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 22:49:16.491992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 22:49:16.491992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 22:49:16.491992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 22:49:16.491992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 22:49:16.491992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 22:49:16.491992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 22:49:16.491992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 22:49:16.491992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 22:49:16.491992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 22:49:16.491992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 22:49:16.491992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 22:49:16.491992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 22:49:16.491992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7138a0de-d835-478b-a542-7577386892fd could not be found. (HTTP 404) (Request-ID: req-8df4666e-a996-4324-8e58-74e8311375a7) Sep 06 22:49:16.491992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:16.491992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:49:16.491992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:16.493172 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:16.493172 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 06 22:49:16.493172 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 06 22:49:16.493172 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 22:49:16.493172 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 22:49:16.493172 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 22:49:16.493172 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 22:49:16.493172 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 22:49:16.493172 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 22:49:16.493172 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 22:49:16.493172 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 22:49:16.493172 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 22:49:16.493172 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 22:49:16.493172 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 22:49:16.493172 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 22:49:16.493172 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 22:49:16.493172 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 22:49:16.493172 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 22:49:16.493172 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 22:49:16.494315 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 22:49:16.494315 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 22:49:16.494315 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 22:49:16.494315 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 22:49:16.494315 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7138a0de-d835-478b-a542-7577386892fd could not be found. Sep 06 22:49:16.494315 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:16.494315 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:49:16.494315 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:16.494315 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:16.494315 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:49:16.494315 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:49:16.494315 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:49:16.494315 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:49:16.494315 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 22:49:16.494315 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 22:49:16.494315 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:49:16.494315 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:49:16.494315 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 06 22:49:16.494315 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:49:16.496183 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7138a0de-d835-478b-a542-7577386892fd could not be found. Sep 06 22:49:16.496183 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:16.496183 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:49:16.496183 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:16.496183 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:16.496183 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:49:16.496183 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:49:16.496183 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:49:16.496183 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:49:16.496183 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7138a0de-d835-478b-a542-7577386892fd could not be found. Sep 06 22:49:16.496183 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:16.496183 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-0bf44c39-46a9-4b8b-ac96-7112a2fa077d tempest-VolumesGetTestJSON-841329172 tempest-VolumesGetTestJSON-841329172-project] Returning 404 to user: Volume 7138a0de-d835-478b-a542-7577386892fd could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:49:16.496183 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-0bf44c39-46a9-4b8b-ac96-7112a2fa077d tempest-VolumesGetTestJSON-841329172 tempest-VolumesGetTestJSON-841329172-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/7138a0de-d835-478b-a542-7577386892fd" status: 404 len: 109 microversion: 2.1 time: 0.048711 Sep 06 22:49:16.498186 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 411/812] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Sep 6 22:49:16 2022] GET /compute/v2.1/os-volumes/7138a0de-d835-478b-a542-7577386892fd => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 22:49:16.547821 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-af291d7f-0cb9-47b0-8f94-fbab1e78fe2e tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:16.559072 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-af291d7f-0cb9-47b0-8f94-fbab1e78fe2e tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1576 microversion: 2.1 time: 0.185265 Sep 06 22:49:16.559986 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 402/813] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:16 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1576 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:49:16.755725 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-bd27b43b-9f1e-4068-a9c8-ee264c337389 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:16.756446 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-bd27b43b-9f1e-4068-a9c8-ee264c337389 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 5acd0d35-4bad-4c55-853d-767fec050879] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:16.768521 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd27b43b-9f1e-4068-a9c8-ee264c337389 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:16.769042 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd27b43b-9f1e-4068-a9c8-ee264c337389 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:16.772441 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd27b43b-9f1e-4068-a9c8-ee264c337389 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:16.773195 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd27b43b-9f1e-4068-a9c8-ee264c337389 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:16.774025 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd27b43b-9f1e-4068-a9c8-ee264c337389 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:16.774457 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bd27b43b-9f1e-4068-a9c8-ee264c337389 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:16.942442 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-bd27b43b-9f1e-4068-a9c8-ee264c337389 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:16.952378 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-bd27b43b-9f1e-4068-a9c8-ee264c337389 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879" status: 200 len: 1266 microversion: 2.1 time: 0.199467 Sep 06 22:49:16.953267 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 412/814] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:16 2022] GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:17.235935 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-82c08351-f30e-4f0b-ad15-95a1150a2adf tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:17.236932 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-82c08351-f30e-4f0b-ad15-95a1150a2adf tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:17.243945 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-82c08351-f30e-4f0b-ad15-95a1150a2adf tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:17.245116 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-82c08351-f30e-4f0b-ad15-95a1150a2adf tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:17.246040 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-82c08351-f30e-4f0b-ad15-95a1150a2adf tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:17.246976 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-82c08351-f30e-4f0b-ad15-95a1150a2adf tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:17.247645 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-82c08351-f30e-4f0b-ad15-95a1150a2adf tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:17.248299 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-82c08351-f30e-4f0b-ad15-95a1150a2adf tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:17.346101 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-af3817ae-8c1a-4f51-8a1a-5560a717d0e6 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:17.348541 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-af3817ae-8c1a-4f51-8a1a-5560a717d0e6 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] [instance: e839f6fc-d10f-4c98-b6f4-9b16ed202d66] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:17.372891 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-af3817ae-8c1a-4f51-8a1a-5560a717d0e6 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:17.373443 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-af3817ae-8c1a-4f51-8a1a-5560a717d0e6 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:17.373939 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-af3817ae-8c1a-4f51-8a1a-5560a717d0e6 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:17.374723 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-af3817ae-8c1a-4f51-8a1a-5560a717d0e6 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:17.375246 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-af3817ae-8c1a-4f51-8a1a-5560a717d0e6 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:17.376843 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-af3817ae-8c1a-4f51-8a1a-5560a717d0e6 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:17.474700 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-af3817ae-8c1a-4f51-8a1a-5560a717d0e6 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5593dc049144447859a48e458717295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3e57c72cec4c128a09749da5a90a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:17.484423 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-82c08351-f30e-4f0b-ad15-95a1150a2adf tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:17.489202 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-af3817ae-8c1a-4f51-8a1a-5560a717d0e6 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] 10.222.0.39 "GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66" status: 200 len: 1218 microversion: 2.1 time: 0.161307 Sep 06 22:49:17.493963 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-82c08351-f30e-4f0b-ad15-95a1150a2adf tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:17.496252 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-82c08351-f30e-4f0b-ad15-95a1150a2adf tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:17.497950 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-82c08351-f30e-4f0b-ad15-95a1150a2adf tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1731 microversion: 2.20 time: 0.265967 Sep 06 22:49:17.498669 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 403/815] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:49:17 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1731 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:49:17.505331 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 413/816] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:17 2022] GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66 => generated 1218 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:17.582828 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0dd99c51-99a6-46ac-8df8-0199449524b3 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:17.583720 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0dd99c51-99a6-46ac-8df8-0199449524b3 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:17.591267 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0dd99c51-99a6-46ac-8df8-0199449524b3 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:17.592118 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0dd99c51-99a6-46ac-8df8-0199449524b3 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:17.592802 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0dd99c51-99a6-46ac-8df8-0199449524b3 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:17.593738 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0dd99c51-99a6-46ac-8df8-0199449524b3 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:17.594411 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0dd99c51-99a6-46ac-8df8-0199449524b3 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:17.595236 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0dd99c51-99a6-46ac-8df8-0199449524b3 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:17.741970 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0dd99c51-99a6-46ac-8df8-0199449524b3 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:17.753963 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0dd99c51-99a6-46ac-8df8-0199449524b3 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1576 microversion: 2.1 time: 0.174862 Sep 06 22:49:17.766135 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 404/817] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:17 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1576 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:17.975463 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-37d8db67-50f4-40e9-9ceb-891876523340 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:17.976196 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-37d8db67-50f4-40e9-9ceb-891876523340 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 5acd0d35-4bad-4c55-853d-767fec050879] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:17.984475 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-37d8db67-50f4-40e9-9ceb-891876523340 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:17.984475 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-37d8db67-50f4-40e9-9ceb-891876523340 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:17.984475 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-37d8db67-50f4-40e9-9ceb-891876523340 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:17.984475 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-37d8db67-50f4-40e9-9ceb-891876523340 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:17.985517 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-37d8db67-50f4-40e9-9ceb-891876523340 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:17.985951 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-37d8db67-50f4-40e9-9ceb-891876523340 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:18.192379 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-37d8db67-50f4-40e9-9ceb-891876523340 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:18.201015 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-37d8db67-50f4-40e9-9ceb-891876523340 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879" status: 200 len: 1266 microversion: 2.1 time: 0.229359 Sep 06 22:49:18.201580 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 414/818] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:17 2022] GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879 => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:18.362039 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-44ee3d7b-3de8-40b5-a69d-8d0a688541f2 tempest-VolumesNegativeTest-1115998429 tempest-VolumesNegativeTest-1115998429-project] Action: 'create', calling method: .version_select at 0x7f9c5300b1f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-195114329", "metadata": {"Type": "work"}}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:49:18.375415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-44ee3d7b-3de8-40b5-a69d-8d0a688541f2 tempest-VolumesNegativeTest-1115998429 tempest-VolumesNegativeTest-1115998429-project] Request method failure captured: Sep 06 22:49:18.375415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 06 22:49:18.375415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept: application/json Sep 06 22:49:18.375415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Sep 06 22:49:18.375415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Connection: close Sep 06 22:49:18.375415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Length: 121 Sep 06 22:49:18.375415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Type: application/json Sep 06 22:49:18.375415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Host: 10.222.0.39 Sep 06 22:49:18.375415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Sep 06 22:49:18.375415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Sep 06 22:49:18.375415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjF85urGo6c4owxHYJJ4vamyyZ0Zramr0Y8N4TWk-_rOvXRS4fRLfIjjbViUe-DY_0ZM66fBvAAuhzV-RACKwBHt0fG2Z1pz4WrhtDYAhEHUTBUjsHC95T6UNNt1VYF4WIqb-Kh8l37KM1vjkRzOLmahwnkRm9vgJ4V_h2zzhqC83wNe0 Sep 06 22:49:18.375415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Sep 06 22:49:18.375415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Sep 06 22:49:18.375415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Sep 06 22:49:18.375415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Sep 06 22:49:18.375415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Sep 06 22:49:18.375415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Sep 06 22:49:18.375415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Id: 480bbdf711b5423ea40389a20dff282c Sep 06 22:49:18.375415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-VolumesNegativeTest-1115998429 Sep 06 22:49:18.375415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Role: reader,member Sep 06 22:49:18.375415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Sep 06 22:49:18.377283 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/480bbdf711b5423ea40389a20dff282c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_480bbdf711b5423ea40389a20dff282c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/480bbdf711b5423ea40389a20dff282c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/480bbdf711b5423ea40389a20dff282c"}]}] Sep 06 22:49:18.377283 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-VolumesNegativeTest-1115998429 Sep 06 22:49:18.377283 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 480bbdf711b5423ea40389a20dff282c Sep 06 22:49:18.377283 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-VolumesNegativeTest-1115998429 Sep 06 22:49:18.377283 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User: tempest-VolumesNegativeTest-1115998429-project Sep 06 22:49:18.377283 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Sep 06 22:49:18.377283 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Sep 06 22:49:18.377283 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Id: 6572838491454d84ba3ba516a6af82c9 Sep 06 22:49:18.377283 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-VolumesNegativeTest-1115998429-project Sep 06 22:49:18.377283 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Sep 06 22:49:18.377283 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-195114329", "metadata": {"Type": "work"}}} Sep 06 22:49:18.377283 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: method: Sep 06 22:49:18.377283 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 06 22:49:18.378415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-195114329', 'metadata': {'Type': 'work'}}}} Sep 06 22:49:18.378415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:49:18.378415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:18.378415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 22:49:18.378415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 22:49:18.378415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 22:49:18.378415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise error Sep 06 22:49:18.378415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 06 22:49:18.378415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.378415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 06 22:49:18.378415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 06 22:49:18.378415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.378415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 06 22:49:18.378415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi '#$%' Sep 06 22:49:18.378415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.378415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:49:18.378415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.378415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:18.378415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:49:18.378415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:49:18.378415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:49:18.378415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:49:18.380289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 22:49:18.380289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 22:49:18.380289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:49:18.380289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:49:18.380289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 22:49:18.380289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 22:49:18.380289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 22:49:18.380289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 22:49:18.380289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 22:49:18.380289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 22:49:18.380289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 06 22:49:18.380289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.380289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:49:18.380289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.380289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:18.380289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:49:18.380289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:49:18.380289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 22:49:18.380289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 22:49:18.381819 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 06 22:49:18.381819 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.383149 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-44ee3d7b-3de8-40b5-a69d-8d0a688541f2 tempest-VolumesNegativeTest-1115998429 tempest-VolumesNegativeTest-1115998429-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:49:18.385203 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-44ee3d7b-3de8-40b5-a69d-8d0a688541f2 tempest-VolumesNegativeTest-1115998429 tempest-VolumesNegativeTest-1115998429-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.146233 Sep 06 22:49:18.386970 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 405/819] 10.222.0.39 () {60 vars in 1156 bytes} [Tue Sep 6 22:49:18 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 148 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 22:49:18.396136 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d81583fb-1727-40c9-abb8-9d0d064faaa6 tempest-VolumesNegativeTest-1115998429 tempest-VolumesNegativeTest-1115998429-project] Action: 'create', calling method: .version_select at 0x7f9c52edd0d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1953590298", "metadata": {"Type": "work"}}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:49:18.401934 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d81583fb-1727-40c9-abb8-9d0d064faaa6 tempest-VolumesNegativeTest-1115998429 tempest-VolumesNegativeTest-1115998429-project] Request method failure captured: Sep 06 22:49:18.401934 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 06 22:49:18.401934 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept: application/json Sep 06 22:49:18.401934 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Sep 06 22:49:18.401934 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Connection: close Sep 06 22:49:18.401934 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Length: 120 Sep 06 22:49:18.401934 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Type: application/json Sep 06 22:49:18.401934 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Host: 10.222.0.39 Sep 06 22:49:18.401934 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Sep 06 22:49:18.401934 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.12 Sep 06 22:49:18.401934 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABjF85urGo6c4owxHYJJ4vamyyZ0Zramr0Y8N4TWk-_rOvXRS4fRLfIjjbViUe-DY_0ZM66fBvAAuhzV-RACKwBHt0fG2Z1pz4WrhtDYAhEHUTBUjsHC95T6UNNt1VYF4WIqb-Kh8l37KM1vjkRzOLmahwnkRm9vgJ4V_h2zzhqC83wNe0 Sep 06 22:49:18.401934 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Sep 06 22:49:18.401934 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Sep 06 22:49:18.401934 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Sep 06 22:49:18.401934 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Sep 06 22:49:18.401934 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Sep 06 22:49:18.401934 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Sep 06 22:49:18.401934 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Id: 480bbdf711b5423ea40389a20dff282c Sep 06 22:49:18.401934 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-VolumesNegativeTest-1115998429 Sep 06 22:49:18.401934 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Role: reader,member Sep 06 22:49:18.401934 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Sep 06 22:49:18.403708 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/480bbdf711b5423ea40389a20dff282c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_480bbdf711b5423ea40389a20dff282c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/480bbdf711b5423ea40389a20dff282c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/480bbdf711b5423ea40389a20dff282c"}]}] Sep 06 22:49:18.403708 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-VolumesNegativeTest-1115998429 Sep 06 22:49:18.403708 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 480bbdf711b5423ea40389a20dff282c Sep 06 22:49:18.403708 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-VolumesNegativeTest-1115998429 Sep 06 22:49:18.403708 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User: tempest-VolumesNegativeTest-1115998429-project Sep 06 22:49:18.403708 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Sep 06 22:49:18.403708 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Sep 06 22:49:18.403708 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Id: 6572838491454d84ba3ba516a6af82c9 Sep 06 22:49:18.403708 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-VolumesNegativeTest-1115998429-project Sep 06 22:49:18.403708 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Sep 06 22:49:18.403708 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1953590298", "metadata": {"Type": "work"}}} Sep 06 22:49:18.403708 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: method: Sep 06 22:49:18.403708 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 06 22:49:18.404700 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1953590298', 'metadata': {'Type': 'work'}}}} Sep 06 22:49:18.404700 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:49:18.404700 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:18.404700 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 22:49:18.404700 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 22:49:18.404700 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 22:49:18.404700 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise error Sep 06 22:49:18.404700 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 06 22:49:18.404700 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.404700 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 06 22:49:18.404700 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 06 22:49:18.404700 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.404700 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 06 22:49:18.404700 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi '0' Sep 06 22:49:18.404700 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.404700 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:49:18.404700 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.404700 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:18.404700 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:49:18.404700 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:49:18.404700 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:49:18.404700 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:49:18.406485 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 22:49:18.406485 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 22:49:18.406485 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:49:18.406485 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:49:18.406485 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 22:49:18.406485 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 22:49:18.406485 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 22:49:18.406485 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 22:49:18.406485 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 22:49:18.406485 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 22:49:18.406485 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 06 22:49:18.406485 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.406485 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:49:18.406485 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.406485 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:18.406485 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:49:18.406485 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:49:18.406485 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 22:49:18.406485 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 22:49:18.407824 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 06 22:49:18.407824 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.407824 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d81583fb-1727-40c9-abb8-9d0d064faaa6 tempest-VolumesNegativeTest-1115998429 tempest-VolumesNegativeTest-1115998429-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:49:18.407824 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d81583fb-1727-40c9-abb8-9d0d064faaa6 tempest-VolumesNegativeTest-1115998429 tempest-VolumesNegativeTest-1115998429-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012220 Sep 06 22:49:18.407824 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 415/820] 10.222.0.39 () {60 vars in 1156 bytes} [Tue Sep 6 22:49:18 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 06 22:49:18.414391 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5178ab9a-6229-459c-8d64-8d123ef9a6b1 tempest-VolumesNegativeTest-1115998429 tempest-VolumesNegativeTest-1115998429-project] Action: 'create', calling method: .version_select at 0x7f9c4f711700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-238204051", "metadata": {"Type": "work"}}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:49:18.420084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5178ab9a-6229-459c-8d64-8d123ef9a6b1 tempest-VolumesNegativeTest-1115998429 tempest-VolumesNegativeTest-1115998429-project] Request method failure captured: Sep 06 22:49:18.420084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 06 22:49:18.420084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept: application/json Sep 06 22:49:18.420084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Sep 06 22:49:18.420084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Connection: close Sep 06 22:49:18.420084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Length: 118 Sep 06 22:49:18.420084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Type: application/json Sep 06 22:49:18.420084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Host: 10.222.0.39 Sep 06 22:49:18.420084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Sep 06 22:49:18.420084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Sep 06 22:49:18.420084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjF85urGo6c4owxHYJJ4vamyyZ0Zramr0Y8N4TWk-_rOvXRS4fRLfIjjbViUe-DY_0ZM66fBvAAuhzV-RACKwBHt0fG2Z1pz4WrhtDYAhEHUTBUjsHC95T6UNNt1VYF4WIqb-Kh8l37KM1vjkRzOLmahwnkRm9vgJ4V_h2zzhqC83wNe0 Sep 06 22:49:18.420084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Sep 06 22:49:18.420084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Sep 06 22:49:18.420084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Sep 06 22:49:18.420084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Sep 06 22:49:18.420084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Sep 06 22:49:18.420084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Sep 06 22:49:18.420084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Id: 480bbdf711b5423ea40389a20dff282c Sep 06 22:49:18.420084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-VolumesNegativeTest-1115998429 Sep 06 22:49:18.420084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Role: reader,member Sep 06 22:49:18.420084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Sep 06 22:49:18.422005 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/480bbdf711b5423ea40389a20dff282c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_480bbdf711b5423ea40389a20dff282c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/480bbdf711b5423ea40389a20dff282c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/480bbdf711b5423ea40389a20dff282c"}]}] Sep 06 22:49:18.422005 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-VolumesNegativeTest-1115998429 Sep 06 22:49:18.422005 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 480bbdf711b5423ea40389a20dff282c Sep 06 22:49:18.422005 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-VolumesNegativeTest-1115998429 Sep 06 22:49:18.422005 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User: tempest-VolumesNegativeTest-1115998429-project Sep 06 22:49:18.422005 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Sep 06 22:49:18.422005 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Sep 06 22:49:18.422005 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Id: 6572838491454d84ba3ba516a6af82c9 Sep 06 22:49:18.422005 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-VolumesNegativeTest-1115998429-project Sep 06 22:49:18.422005 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Sep 06 22:49:18.422005 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-238204051", "metadata": {"Type": "work"}}} Sep 06 22:49:18.422005 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: method: Sep 06 22:49:18.422005 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 06 22:49:18.422799 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-238204051', 'metadata': {'Type': 'work'}}}} Sep 06 22:49:18.422799 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:49:18.422799 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:18.422799 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 22:49:18.422799 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 22:49:18.422799 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 22:49:18.422799 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise error Sep 06 22:49:18.422799 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 06 22:49:18.422799 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.422799 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 06 22:49:18.422799 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 06 22:49:18.422799 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.422799 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 06 22:49:18.422799 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi '' Sep 06 22:49:18.422799 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.422799 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:49:18.422799 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.422799 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:18.422799 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:49:18.422799 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:49:18.422799 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:49:18.422799 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:49:18.424142 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 22:49:18.424142 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 22:49:18.424142 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:49:18.424142 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:49:18.424142 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 22:49:18.424142 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 22:49:18.424142 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 22:49:18.424142 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 22:49:18.424142 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 22:49:18.424142 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 22:49:18.424142 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 06 22:49:18.424142 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.424142 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:49:18.424142 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.424142 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:18.424142 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:49:18.424142 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:49:18.424142 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 22:49:18.424142 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 22:49:18.425687 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 06 22:49:18.425687 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.425687 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5178ab9a-6229-459c-8d64-8d123ef9a6b1 tempest-VolumesNegativeTest-1115998429 tempest-VolumesNegativeTest-1115998429-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:49:18.425687 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5178ab9a-6229-459c-8d64-8d123ef9a6b1 tempest-VolumesNegativeTest-1115998429 tempest-VolumesNegativeTest-1115998429-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011250 Sep 06 22:49:18.425687 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 406/821] 10.222.0.39 () {60 vars in 1156 bytes} [Tue Sep 6 22:49:18 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 22:49:18.431996 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6144f841-0c2d-4ab5-b2e3-84a1946ba734 tempest-VolumesNegativeTest-1115998429 tempest-VolumesNegativeTest-1115998429-project] Calling method '.version_select at 0x7f9c52fe7940>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:18.464478 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-6144f841-0c2d-4ab5-b2e3-84a1946ba734 tempest-VolumesNegativeTest-1115998429 tempest-VolumesNegativeTest-1115998429-project] HTTP exception thrown: Volume tempest-invalid-2084507120 could not be found. Sep 06 22:49:18.466357 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6144f841-0c2d-4ab5-b2e3-84a1946ba734 tempest-VolumesNegativeTest-1115998429 tempest-VolumesNegativeTest-1115998429-project] Request method failure captured: Sep 06 22:49:18.466357 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2084507120 HTTP/1.1 Sep 06 22:49:18.466357 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept: application/json Sep 06 22:49:18.466357 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Sep 06 22:49:18.466357 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Connection: close Sep 06 22:49:18.466357 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Length: 0 Sep 06 22:49:18.466357 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Type: application/json Sep 06 22:49:18.466357 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Host: 10.222.0.39 Sep 06 22:49:18.466357 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Sep 06 22:49:18.466357 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.12 Sep 06 22:49:18.466357 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABjF85urGo6c4owxHYJJ4vamyyZ0Zramr0Y8N4TWk-_rOvXRS4fRLfIjjbViUe-DY_0ZM66fBvAAuhzV-RACKwBHt0fG2Z1pz4WrhtDYAhEHUTBUjsHC95T6UNNt1VYF4WIqb-Kh8l37KM1vjkRzOLmahwnkRm9vgJ4V_h2zzhqC83wNe0 Sep 06 22:49:18.466357 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Sep 06 22:49:18.466357 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Sep 06 22:49:18.466357 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Sep 06 22:49:18.466357 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Sep 06 22:49:18.466357 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Sep 06 22:49:18.466357 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Sep 06 22:49:18.466357 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Id: 480bbdf711b5423ea40389a20dff282c Sep 06 22:49:18.466357 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-VolumesNegativeTest-1115998429 Sep 06 22:49:18.466357 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Role: reader,member Sep 06 22:49:18.466357 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Sep 06 22:49:18.467932 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/480bbdf711b5423ea40389a20dff282c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_480bbdf711b5423ea40389a20dff282c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/480bbdf711b5423ea40389a20dff282c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/480bbdf711b5423ea40389a20dff282c"}]}] Sep 06 22:49:18.467932 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-VolumesNegativeTest-1115998429 Sep 06 22:49:18.467932 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 480bbdf711b5423ea40389a20dff282c Sep 06 22:49:18.467932 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-VolumesNegativeTest-1115998429 Sep 06 22:49:18.467932 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User: tempest-VolumesNegativeTest-1115998429-project Sep 06 22:49:18.467932 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Sep 06 22:49:18.467932 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Sep 06 22:49:18.467932 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Id: 6572838491454d84ba3ba516a6af82c9 Sep 06 22:49:18.467932 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-VolumesNegativeTest-1115998429-project Sep 06 22:49:18.467932 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: method: Sep 06 22:49:18.467932 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: exception: Volume tempest-invalid-2084507120 could not be found. Sep 06 22:49:18.467932 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: action_args: {'id': 'tempest-invalid-2084507120'} Sep 06 22:49:18.467932 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:49:18.468829 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:18.468829 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 22:49:18.468829 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 22:49:18.468829 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 22:49:18.468829 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 22:49:18.468829 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 22:49:18.468829 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 22:49:18.468829 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 22:49:18.468829 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 22:49:18.468829 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 22:49:18.468829 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 22:49:18.468829 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 22:49:18.468829 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 22:49:18.468829 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 22:49:18.468829 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 22:49:18.468829 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2084507120 could not be found. (HTTP 404) (Request-ID: req-6cfaca4b-d582-4e8e-b578-dcc620e55a00) Sep 06 22:49:18.468829 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.468829 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:49:18.468829 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.469961 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:18.469961 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 06 22:49:18.469961 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 06 22:49:18.469961 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 22:49:18.469961 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 22:49:18.469961 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 22:49:18.469961 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 22:49:18.469961 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 22:49:18.469961 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 22:49:18.469961 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 22:49:18.469961 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 22:49:18.469961 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 22:49:18.469961 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 22:49:18.469961 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 22:49:18.469961 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 22:49:18.469961 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 22:49:18.469961 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 22:49:18.469961 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 22:49:18.469961 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 22:49:18.471124 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 22:49:18.471124 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 22:49:18.471124 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 22:49:18.471124 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 22:49:18.471124 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2084507120 could not be found. Sep 06 22:49:18.471124 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.471124 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:49:18.471124 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.471124 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:18.471124 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:49:18.471124 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:49:18.471124 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:49:18.471124 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:49:18.471124 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 22:49:18.471124 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 22:49:18.471124 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:49:18.471124 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:49:18.471124 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 06 22:49:18.471124 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:49:18.471124 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2084507120 could not be found. Sep 06 22:49:18.472464 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.472464 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:49:18.472464 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.472464 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:18.472464 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:49:18.472464 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:49:18.472464 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:49:18.472464 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:49:18.472464 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2084507120 could not be found. Sep 06 22:49:18.472464 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.472464 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6144f841-0c2d-4ab5-b2e3-84a1946ba734 tempest-VolumesNegativeTest-1115998429 tempest-VolumesNegativeTest-1115998429-project] Returning 404 to user: Volume tempest-invalid-2084507120 could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:49:18.472464 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-6144f841-0c2d-4ab5-b2e3-84a1946ba734 tempest-VolumesNegativeTest-1115998429 tempest-VolumesNegativeTest-1115998429-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2084507120" status: 404 len: 99 microversion: 2.1 time: 0.040343 Sep 06 22:49:18.472464 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 416/822] 10.222.0.39 () {58 vars in 1218 bytes} [Tue Sep 6 22:49:18 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2084507120 => generated 99 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 22:49:18.477971 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d6bf2810-8d58-4f8f-853d-9a9091643ae8 tempest-VolumesNegativeTest-1115998429 tempest-VolumesNegativeTest-1115998429-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003853 Sep 06 22:49:18.478479 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 407/823] 10.222.0.39 () {58 vars in 1140 bytes} [Tue Sep 6 22:49:18 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 06 22:49:18.487893 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-2c757dc9-0b52-43cd-9ca6-67d04ac7903f tempest-VolumesNegativeTest-1115998429 tempest-VolumesNegativeTest-1115998429-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003791 Sep 06 22:49:18.488484 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 417/824] 10.222.0.39 () {58 vars in 1137 bytes} [Tue Sep 6 22:49:18 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 06 22:49:18.498476 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6d696a62-4311-4feb-b986-71fe06b62114 tempest-VolumesNegativeTest-1115998429 tempest-VolumesNegativeTest-1115998429-project] Calling method '.version_select at 0x7f9c52ffea60>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:18.530381 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-6d696a62-4311-4feb-b986-71fe06b62114 tempest-VolumesNegativeTest-1115998429 tempest-VolumesNegativeTest-1115998429-project] HTTP exception thrown: Volume 3615a672-4df5-404a-874c-e617f418cd2d could not be found. Sep 06 22:49:18.531812 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-4e316768-4382-4c64-b6b1-de80379b3e12 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:18.532694 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6d696a62-4311-4feb-b986-71fe06b62114 tempest-VolumesNegativeTest-1115998429 tempest-VolumesNegativeTest-1115998429-project] Request method failure captured: Sep 06 22:49:18.532694 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: request: DELETE /compute/v2.1/os-volumes/3615a672-4df5-404a-874c-e617f418cd2d HTTP/1.1 Sep 06 22:49:18.532694 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept: application/json Sep 06 22:49:18.532694 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Sep 06 22:49:18.532694 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Connection: close Sep 06 22:49:18.532694 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Length: 0 Sep 06 22:49:18.532694 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Type: application/json Sep 06 22:49:18.532694 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Host: 10.222.0.39 Sep 06 22:49:18.532694 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Sep 06 22:49:18.532694 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Sep 06 22:49:18.532694 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjF85urGo6c4owxHYJJ4vamyyZ0Zramr0Y8N4TWk-_rOvXRS4fRLfIjjbViUe-DY_0ZM66fBvAAuhzV-RACKwBHt0fG2Z1pz4WrhtDYAhEHUTBUjsHC95T6UNNt1VYF4WIqb-Kh8l37KM1vjkRzOLmahwnkRm9vgJ4V_h2zzhqC83wNe0 Sep 06 22:49:18.532694 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Sep 06 22:49:18.532694 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Sep 06 22:49:18.532694 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Sep 06 22:49:18.532694 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Sep 06 22:49:18.532694 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Sep 06 22:49:18.532694 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Sep 06 22:49:18.532694 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Id: 480bbdf711b5423ea40389a20dff282c Sep 06 22:49:18.532694 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-VolumesNegativeTest-1115998429 Sep 06 22:49:18.532694 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Role: reader,member Sep 06 22:49:18.532694 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Sep 06 22:49:18.534301 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/480bbdf711b5423ea40389a20dff282c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_480bbdf711b5423ea40389a20dff282c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/480bbdf711b5423ea40389a20dff282c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/480bbdf711b5423ea40389a20dff282c"}]}] Sep 06 22:49:18.534301 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-VolumesNegativeTest-1115998429 Sep 06 22:49:18.534301 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 480bbdf711b5423ea40389a20dff282c Sep 06 22:49:18.534301 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-VolumesNegativeTest-1115998429 Sep 06 22:49:18.534301 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User: tempest-VolumesNegativeTest-1115998429-project Sep 06 22:49:18.534301 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Sep 06 22:49:18.534301 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Sep 06 22:49:18.534301 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Id: 6572838491454d84ba3ba516a6af82c9 Sep 06 22:49:18.534301 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-VolumesNegativeTest-1115998429-project Sep 06 22:49:18.534301 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: method: Sep 06 22:49:18.534301 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: exception: Volume 3615a672-4df5-404a-874c-e617f418cd2d could not be found. Sep 06 22:49:18.534301 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: action_args: {'id': '3615a672-4df5-404a-874c-e617f418cd2d'} Sep 06 22:49:18.534301 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:49:18.535287 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:18.535287 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 22:49:18.535287 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 22:49:18.535287 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 22:49:18.535287 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 22:49:18.535287 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 22:49:18.535287 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 22:49:18.535287 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 22:49:18.535287 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 22:49:18.535287 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 22:49:18.535287 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 22:49:18.535287 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 22:49:18.535287 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 22:49:18.535287 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 22:49:18.535287 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 22:49:18.535287 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3615a672-4df5-404a-874c-e617f418cd2d could not be found. (HTTP 404) (Request-ID: req-aacf6e77-f966-40f9-b32d-2a1ca0e36723) Sep 06 22:49:18.535287 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.535287 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:49:18.535287 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.536646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:18.536646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 06 22:49:18.536646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 06 22:49:18.536646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 22:49:18.536646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 22:49:18.536646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 22:49:18.536646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 22:49:18.536646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 22:49:18.536646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 22:49:18.536646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 22:49:18.536646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 22:49:18.536646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 22:49:18.536646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 22:49:18.536646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 22:49:18.536646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 22:49:18.536646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 22:49:18.536646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 22:49:18.536646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 22:49:18.536646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 22:49:18.538074 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 22:49:18.538074 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 22:49:18.538074 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 22:49:18.538074 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 22:49:18.538074 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3615a672-4df5-404a-874c-e617f418cd2d could not be found. Sep 06 22:49:18.538074 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.538074 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:49:18.538074 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.538074 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:18.538074 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:49:18.538074 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:49:18.538074 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:49:18.538074 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:49:18.538074 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 22:49:18.538074 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 22:49:18.538074 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:49:18.538074 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:49:18.538074 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 06 22:49:18.538074 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:49:18.539454 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3615a672-4df5-404a-874c-e617f418cd2d could not be found. Sep 06 22:49:18.539454 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.539454 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:49:18.539454 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.539454 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:18.539454 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:49:18.539454 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:49:18.539454 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:49:18.539454 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:49:18.539454 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3615a672-4df5-404a-874c-e617f418cd2d could not be found. Sep 06 22:49:18.539454 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.540253 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-4e316768-4382-4c64-b6b1-de80379b3e12 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:18.540907 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6d696a62-4311-4feb-b986-71fe06b62114 tempest-VolumesNegativeTest-1115998429 tempest-VolumesNegativeTest-1115998429-project] Returning 404 to user: Volume 3615a672-4df5-404a-874c-e617f418cd2d could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:49:18.542409 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6d696a62-4311-4feb-b986-71fe06b62114 tempest-VolumesNegativeTest-1115998429 tempest-VolumesNegativeTest-1115998429-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/3615a672-4df5-404a-874c-e617f418cd2d" status: 404 len: 109 microversion: 2.1 time: 0.047989 Sep 06 22:49:18.544856 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 408/825] 10.222.0.39 () {58 vars in 1248 bytes} [Tue Sep 6 22:49:18 2022] DELETE /compute/v2.1/os-volumes/3615a672-4df5-404a-874c-e617f418cd2d => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 22:49:18.551460 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-daa7b642-68fb-4b51-8ee0-f3378e64674b tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:18.551672 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4e316768-4382-4c64-b6b1-de80379b3e12 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:18.552156 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4e316768-4382-4c64-b6b1-de80379b3e12 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:18.552669 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4e316768-4382-4c64-b6b1-de80379b3e12 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:18.553215 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-daa7b642-68fb-4b51-8ee0-f3378e64674b tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] [instance: e839f6fc-d10f-4c98-b6f4-9b16ed202d66] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:18.553467 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4e316768-4382-4c64-b6b1-de80379b3e12 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:18.553995 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4e316768-4382-4c64-b6b1-de80379b3e12 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:18.554490 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4e316768-4382-4c64-b6b1-de80379b3e12 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:18.562609 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-daa7b642-68fb-4b51-8ee0-f3378e64674b tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:18.563252 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-daa7b642-68fb-4b51-8ee0-f3378e64674b tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:18.563786 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-daa7b642-68fb-4b51-8ee0-f3378e64674b tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:18.564733 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-daa7b642-68fb-4b51-8ee0-f3378e64674b tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:18.565318 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-daa7b642-68fb-4b51-8ee0-f3378e64674b tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:18.565847 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-daa7b642-68fb-4b51-8ee0-f3378e64674b tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:18.665555 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-daa7b642-68fb-4b51-8ee0-f3378e64674b tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5593dc049144447859a48e458717295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3e57c72cec4c128a09749da5a90a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:18.677260 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-daa7b642-68fb-4b51-8ee0-f3378e64674b tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] 10.222.0.39 "GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66" status: 200 len: 1218 microversion: 2.1 time: 0.132688 Sep 06 22:49:18.678436 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 409/826] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:18 2022] GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66 => generated 1218 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:18.683431 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b64ac0ad-86e3-4044-92b7-03c4121badef tempest-VolumesNegativeTest-1115998429 tempest-VolumesNegativeTest-1115998429-project] Calling method '.version_select at 0x7f9c4f711040>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:18.721884 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-b64ac0ad-86e3-4044-92b7-03c4121badef tempest-VolumesNegativeTest-1115998429 tempest-VolumesNegativeTest-1115998429-project] HTTP exception thrown: Volume 892c102c-e819-480a-8662-ce6665270790 could not be found. Sep 06 22:49:18.724341 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b64ac0ad-86e3-4044-92b7-03c4121badef tempest-VolumesNegativeTest-1115998429 tempest-VolumesNegativeTest-1115998429-project] Request method failure captured: Sep 06 22:49:18.724341 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/os-volumes/892c102c-e819-480a-8662-ce6665270790 HTTP/1.1 Sep 06 22:49:18.724341 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept: application/json Sep 06 22:49:18.724341 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Sep 06 22:49:18.724341 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Connection: close Sep 06 22:49:18.724341 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Length: 0 Sep 06 22:49:18.724341 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Type: application/json Sep 06 22:49:18.724341 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Host: 10.222.0.39 Sep 06 22:49:18.724341 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Sep 06 22:49:18.724341 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Sep 06 22:49:18.724341 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjF85urGo6c4owxHYJJ4vamyyZ0Zramr0Y8N4TWk-_rOvXRS4fRLfIjjbViUe-DY_0ZM66fBvAAuhzV-RACKwBHt0fG2Z1pz4WrhtDYAhEHUTBUjsHC95T6UNNt1VYF4WIqb-Kh8l37KM1vjkRzOLmahwnkRm9vgJ4V_h2zzhqC83wNe0 Sep 06 22:49:18.724341 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Sep 06 22:49:18.724341 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Sep 06 22:49:18.724341 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Sep 06 22:49:18.724341 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Sep 06 22:49:18.724341 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Sep 06 22:49:18.724341 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Sep 06 22:49:18.724341 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Id: 480bbdf711b5423ea40389a20dff282c Sep 06 22:49:18.724341 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-VolumesNegativeTest-1115998429 Sep 06 22:49:18.724341 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Role: reader,member Sep 06 22:49:18.724341 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Sep 06 22:49:18.726088 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/480bbdf711b5423ea40389a20dff282c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_480bbdf711b5423ea40389a20dff282c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/480bbdf711b5423ea40389a20dff282c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/480bbdf711b5423ea40389a20dff282c"}]}] Sep 06 22:49:18.726088 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-VolumesNegativeTest-1115998429 Sep 06 22:49:18.726088 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 480bbdf711b5423ea40389a20dff282c Sep 06 22:49:18.726088 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-VolumesNegativeTest-1115998429 Sep 06 22:49:18.726088 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User: tempest-VolumesNegativeTest-1115998429-project Sep 06 22:49:18.726088 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Sep 06 22:49:18.726088 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Sep 06 22:49:18.726088 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Id: 6572838491454d84ba3ba516a6af82c9 Sep 06 22:49:18.726088 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-VolumesNegativeTest-1115998429-project Sep 06 22:49:18.726088 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: method: Sep 06 22:49:18.726088 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: exception: Volume 892c102c-e819-480a-8662-ce6665270790 could not be found. Sep 06 22:49:18.726088 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: action_args: {'id': '892c102c-e819-480a-8662-ce6665270790'} Sep 06 22:49:18.726088 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:49:18.727204 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:18.727204 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 22:49:18.727204 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 22:49:18.727204 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 22:49:18.727204 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 22:49:18.727204 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 22:49:18.727204 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 22:49:18.727204 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 22:49:18.727204 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 22:49:18.727204 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 22:49:18.727204 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 22:49:18.727204 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 22:49:18.727204 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 22:49:18.727204 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 22:49:18.727204 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 22:49:18.727204 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 892c102c-e819-480a-8662-ce6665270790 could not be found. (HTTP 404) (Request-ID: req-e841cdda-726a-47e3-87ea-fb9fedf8330c) Sep 06 22:49:18.727204 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.727204 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:49:18.727204 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.728646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:18.728646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 06 22:49:18.728646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 06 22:49:18.728646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 22:49:18.728646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 22:49:18.728646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 22:49:18.728646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 22:49:18.728646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 22:49:18.728646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 22:49:18.728646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 22:49:18.728646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 22:49:18.728646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 22:49:18.728646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 22:49:18.728646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 22:49:18.728646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 22:49:18.728646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 22:49:18.728646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 22:49:18.728646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 22:49:18.728646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 22:49:18.730502 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 22:49:18.730502 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 22:49:18.730502 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 22:49:18.730502 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 22:49:18.730502 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 892c102c-e819-480a-8662-ce6665270790 could not be found. Sep 06 22:49:18.730502 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.730502 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:49:18.730502 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.730502 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:18.730502 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:49:18.730502 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:49:18.730502 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:49:18.730502 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:49:18.730502 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 22:49:18.730502 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 22:49:18.730502 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:49:18.730502 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:49:18.730502 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 06 22:49:18.730502 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:49:18.732716 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 892c102c-e819-480a-8662-ce6665270790 could not be found. Sep 06 22:49:18.732716 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.732716 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:49:18.732716 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.732716 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:18.732716 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:49:18.732716 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:49:18.732716 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:49:18.732716 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:49:18.732716 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 892c102c-e819-480a-8662-ce6665270790 could not be found. Sep 06 22:49:18.732716 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:49:18.734863 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b64ac0ad-86e3-4044-92b7-03c4121badef tempest-VolumesNegativeTest-1115998429 tempest-VolumesNegativeTest-1115998429-project] Returning 404 to user: Volume 892c102c-e819-480a-8662-ce6665270790 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:49:18.735921 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b64ac0ad-86e3-4044-92b7-03c4121badef tempest-VolumesNegativeTest-1115998429 tempest-VolumesNegativeTest-1115998429-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/892c102c-e819-480a-8662-ce6665270790" status: 404 len: 109 microversion: 2.1 time: 0.056360 Sep 06 22:49:18.736996 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 410/827] 10.222.0.39 () {58 vars in 1245 bytes} [Tue Sep 6 22:49:18 2022] GET /compute/v2.1/os-volumes/892c102c-e819-480a-8662-ce6665270790 => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 22:49:18.752315 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-4e316768-4382-4c64-b6b1-de80379b3e12 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:18.762009 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-4e316768-4382-4c64-b6b1-de80379b3e12 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:18.763913 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-4e316768-4382-4c64-b6b1-de80379b3e12 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:18.765328 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-4e316768-4382-4c64-b6b1-de80379b3e12 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1731 microversion: 2.20 time: 0.239306 Sep 06 22:49:18.770147 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 418/828] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:49:18 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1731 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 22:49:18.787465 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c835c2a2-a100-4ab0-a331-f5b2538c2702 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:18.788628 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c835c2a2-a100-4ab0-a331-f5b2538c2702 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:18.797993 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c835c2a2-a100-4ab0-a331-f5b2538c2702 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:18.798733 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c835c2a2-a100-4ab0-a331-f5b2538c2702 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:18.799310 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c835c2a2-a100-4ab0-a331-f5b2538c2702 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:18.800016 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c835c2a2-a100-4ab0-a331-f5b2538c2702 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:18.800470 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c835c2a2-a100-4ab0-a331-f5b2538c2702 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:18.800967 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c835c2a2-a100-4ab0-a331-f5b2538c2702 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:19.012491 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c835c2a2-a100-4ab0-a331-f5b2538c2702 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:19.028034 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c835c2a2-a100-4ab0-a331-f5b2538c2702 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1576 microversion: 2.1 time: 0.244719 Sep 06 22:49:19.029511 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 411/829] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:18 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1576 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:19.232006 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-1d34141c-7363-4069-847e-d65af26e290e tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:19.233717 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-1d34141c-7363-4069-847e-d65af26e290e tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 5acd0d35-4bad-4c55-853d-767fec050879] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:19.244905 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1d34141c-7363-4069-847e-d65af26e290e tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:19.246101 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1d34141c-7363-4069-847e-d65af26e290e tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:19.246963 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1d34141c-7363-4069-847e-d65af26e290e tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:19.248217 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1d34141c-7363-4069-847e-d65af26e290e tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:19.249069 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1d34141c-7363-4069-847e-d65af26e290e tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:19.250246 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1d34141c-7363-4069-847e-d65af26e290e tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:19.283567 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:19.462285 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-1d34141c-7363-4069-847e-d65af26e290e tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:19.478584 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-1d34141c-7363-4069-847e-d65af26e290e tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879" status: 200 len: 1266 microversion: 2.1 time: 0.254325 Sep 06 22:49:19.495747 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 419/830] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:19 2022] GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879 => generated 1266 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:19.700252 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ce5aa805-7f62-4545-8a61-7ff58ebf5be3 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:19.701154 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ce5aa805-7f62-4545-8a61-7ff58ebf5be3 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] [instance: e839f6fc-d10f-4c98-b6f4-9b16ed202d66] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:19.707397 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ce5aa805-7f62-4545-8a61-7ff58ebf5be3 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:19.707883 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ce5aa805-7f62-4545-8a61-7ff58ebf5be3 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:19.708312 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ce5aa805-7f62-4545-8a61-7ff58ebf5be3 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:19.709433 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ce5aa805-7f62-4545-8a61-7ff58ebf5be3 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:19.709954 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ce5aa805-7f62-4545-8a61-7ff58ebf5be3 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:19.710441 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ce5aa805-7f62-4545-8a61-7ff58ebf5be3 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:19.785257 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ce5aa805-7f62-4545-8a61-7ff58ebf5be3 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5593dc049144447859a48e458717295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3e57c72cec4c128a09749da5a90a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:19.795083 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-14d28bfc-8cf6-48e9-9e45-75a924c38e81 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:19.795945 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-14d28bfc-8cf6-48e9-9e45-75a924c38e81 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:19.810718 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ce5aa805-7f62-4545-8a61-7ff58ebf5be3 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] 10.222.0.39 "GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66" status: 200 len: 1218 microversion: 2.1 time: 0.114360 Sep 06 22:49:19.812735 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-14d28bfc-8cf6-48e9-9e45-75a924c38e81 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:19.813159 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 412/831] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:19 2022] GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66 => generated 1218 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:49:19.813828 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-14d28bfc-8cf6-48e9-9e45-75a924c38e81 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:19.814648 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-14d28bfc-8cf6-48e9-9e45-75a924c38e81 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:19.815593 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-14d28bfc-8cf6-48e9-9e45-75a924c38e81 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:19.816141 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-14d28bfc-8cf6-48e9-9e45-75a924c38e81 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:19.816676 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-14d28bfc-8cf6-48e9-9e45-75a924c38e81 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:19.993130 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-14d28bfc-8cf6-48e9-9e45-75a924c38e81 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:20.002506 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-14d28bfc-8cf6-48e9-9e45-75a924c38e81 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:20.004285 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-14d28bfc-8cf6-48e9-9e45-75a924c38e81 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:20.005702 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-14d28bfc-8cf6-48e9-9e45-75a924c38e81 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1731 microversion: 2.20 time: 0.215628 Sep 06 22:49:20.006738 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 420/832] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:49:19 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1731 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 22:49:20.054475 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-35478a69-c31f-4896-a313-c160478cc3be tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:20.055000 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-35478a69-c31f-4896-a313-c160478cc3be tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:20.062393 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35478a69-c31f-4896-a313-c160478cc3be tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:20.063017 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35478a69-c31f-4896-a313-c160478cc3be tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:20.063573 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35478a69-c31f-4896-a313-c160478cc3be tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:20.064658 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35478a69-c31f-4896-a313-c160478cc3be tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:20.065403 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35478a69-c31f-4896-a313-c160478cc3be tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:20.066128 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35478a69-c31f-4896-a313-c160478cc3be tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:20.275654 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-35478a69-c31f-4896-a313-c160478cc3be tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:20.285209 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-35478a69-c31f-4896-a313-c160478cc3be tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1576 microversion: 2.1 time: 0.234538 Sep 06 22:49:20.285813 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 413/833] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:20 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1576 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:20.501965 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6f7454bb-d571-4eed-b02f-f1ee1d64eae8 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:20.502634 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-6f7454bb-d571-4eed-b02f-f1ee1d64eae8 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 5acd0d35-4bad-4c55-853d-767fec050879] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:20.509039 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6f7454bb-d571-4eed-b02f-f1ee1d64eae8 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:20.509928 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6f7454bb-d571-4eed-b02f-f1ee1d64eae8 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:20.511223 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6f7454bb-d571-4eed-b02f-f1ee1d64eae8 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:20.512003 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6f7454bb-d571-4eed-b02f-f1ee1d64eae8 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:20.512526 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6f7454bb-d571-4eed-b02f-f1ee1d64eae8 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:20.513036 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6f7454bb-d571-4eed-b02f-f1ee1d64eae8 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:20.684333 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6f7454bb-d571-4eed-b02f-f1ee1d64eae8 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:20.698026 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-6f7454bb-d571-4eed-b02f-f1ee1d64eae8 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879" status: 200 len: 1266 microversion: 2.1 time: 0.199509 Sep 06 22:49:20.720167 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 421/834] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:20 2022] GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879 => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:20.836311 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-340e1f3c-dd9c-4321-ab3e-e5378911b6b1 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:20.841101 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-340e1f3c-dd9c-4321-ab3e-e5378911b6b1 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] [instance: e839f6fc-d10f-4c98-b6f4-9b16ed202d66] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:20.848720 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-340e1f3c-dd9c-4321-ab3e-e5378911b6b1 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:20.849307 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-340e1f3c-dd9c-4321-ab3e-e5378911b6b1 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:20.850048 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-340e1f3c-dd9c-4321-ab3e-e5378911b6b1 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:20.850952 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-340e1f3c-dd9c-4321-ab3e-e5378911b6b1 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:20.851593 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-340e1f3c-dd9c-4321-ab3e-e5378911b6b1 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:20.852226 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-340e1f3c-dd9c-4321-ab3e-e5378911b6b1 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:20.931234 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-340e1f3c-dd9c-4321-ab3e-e5378911b6b1 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5593dc049144447859a48e458717295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3e57c72cec4c128a09749da5a90a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:20.944254 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-340e1f3c-dd9c-4321-ab3e-e5378911b6b1 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] 10.222.0.39 "GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66" status: 200 len: 1218 microversion: 2.1 time: 0.111794 Sep 06 22:49:20.946509 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 414/835] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:20 2022] GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66 => generated 1218 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:21.033508 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-279ca88a-a996-408b-95ba-8834bd9dbe1d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:21.034526 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-279ca88a-a996-408b-95ba-8834bd9dbe1d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:21.041083 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-279ca88a-a996-408b-95ba-8834bd9dbe1d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:21.042166 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-279ca88a-a996-408b-95ba-8834bd9dbe1d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:21.042802 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-279ca88a-a996-408b-95ba-8834bd9dbe1d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:21.047545 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-279ca88a-a996-408b-95ba-8834bd9dbe1d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:21.048871 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-279ca88a-a996-408b-95ba-8834bd9dbe1d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:21.049610 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-279ca88a-a996-408b-95ba-8834bd9dbe1d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:21.259056 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-279ca88a-a996-408b-95ba-8834bd9dbe1d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:21.282835 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-279ca88a-a996-408b-95ba-8834bd9dbe1d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:21.284974 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-279ca88a-a996-408b-95ba-8834bd9dbe1d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:21.287559 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-279ca88a-a996-408b-95ba-8834bd9dbe1d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1731 microversion: 2.20 time: 0.258590 Sep 06 22:49:21.288370 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 422/836] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:49:21 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1731 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:49:21.314564 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c220b370-0b23-4565-b8ac-ac8306497d72 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:21.315176 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c220b370-0b23-4565-b8ac-ac8306497d72 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:21.328251 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c220b370-0b23-4565-b8ac-ac8306497d72 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:21.328749 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c220b370-0b23-4565-b8ac-ac8306497d72 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:21.329499 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c220b370-0b23-4565-b8ac-ac8306497d72 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:21.330712 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c220b370-0b23-4565-b8ac-ac8306497d72 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:21.331179 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c220b370-0b23-4565-b8ac-ac8306497d72 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:21.331744 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c220b370-0b23-4565-b8ac-ac8306497d72 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:21.495597 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c220b370-0b23-4565-b8ac-ac8306497d72 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:21.504651 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c220b370-0b23-4565-b8ac-ac8306497d72 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1576 microversion: 2.1 time: 0.199625 Sep 06 22:49:21.505309 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 415/837] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:21 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1576 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:21.721517 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e7b64853-ae72-4271-8ae6-05b494d33162 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:21.722198 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e7b64853-ae72-4271-8ae6-05b494d33162 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 5acd0d35-4bad-4c55-853d-767fec050879] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:21.728316 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e7b64853-ae72-4271-8ae6-05b494d33162 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:21.728835 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e7b64853-ae72-4271-8ae6-05b494d33162 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:21.729726 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e7b64853-ae72-4271-8ae6-05b494d33162 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:21.730495 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e7b64853-ae72-4271-8ae6-05b494d33162 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:21.730946 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e7b64853-ae72-4271-8ae6-05b494d33162 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:21.731362 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e7b64853-ae72-4271-8ae6-05b494d33162 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:21.872512 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e7b64853-ae72-4271-8ae6-05b494d33162 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:21.880132 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e7b64853-ae72-4271-8ae6-05b494d33162 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879" status: 200 len: 1266 microversion: 2.1 time: 0.162380 Sep 06 22:49:21.880689 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 423/838] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:21 2022] GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:21.972518 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-cb852bbb-2b55-443e-8bd1-098b71fd366f tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:21.973117 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-cb852bbb-2b55-443e-8bd1-098b71fd366f tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] [instance: e839f6fc-d10f-4c98-b6f4-9b16ed202d66] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:21.980202 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb852bbb-2b55-443e-8bd1-098b71fd366f tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:21.980864 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb852bbb-2b55-443e-8bd1-098b71fd366f tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:21.981303 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb852bbb-2b55-443e-8bd1-098b71fd366f tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:21.981994 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb852bbb-2b55-443e-8bd1-098b71fd366f tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:21.982446 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb852bbb-2b55-443e-8bd1-098b71fd366f tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:21.982868 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-cb852bbb-2b55-443e-8bd1-098b71fd366f tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:21.998391 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:22.046792 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-cb852bbb-2b55-443e-8bd1-098b71fd366f tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5593dc049144447859a48e458717295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3e57c72cec4c128a09749da5a90a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:22.054767 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-cb852bbb-2b55-443e-8bd1-098b71fd366f tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] 10.222.0.39 "GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66" status: 200 len: 1218 microversion: 2.1 time: 0.086226 Sep 06 22:49:22.055337 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 416/839] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:21 2022] GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:22.318485 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-8de30d92-7527-47da-9ea5-cf0e8a2710aa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:22.319012 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-8de30d92-7527-47da-9ea5-cf0e8a2710aa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:22.325363 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8de30d92-7527-47da-9ea5-cf0e8a2710aa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:22.325849 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8de30d92-7527-47da-9ea5-cf0e8a2710aa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:22.326277 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8de30d92-7527-47da-9ea5-cf0e8a2710aa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:22.326963 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8de30d92-7527-47da-9ea5-cf0e8a2710aa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:22.327410 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8de30d92-7527-47da-9ea5-cf0e8a2710aa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:22.327827 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8de30d92-7527-47da-9ea5-cf0e8a2710aa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:22.461460 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-8de30d92-7527-47da-9ea5-cf0e8a2710aa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:22.470226 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-8de30d92-7527-47da-9ea5-cf0e8a2710aa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:22.471679 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-8de30d92-7527-47da-9ea5-cf0e8a2710aa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:22.472842 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-8de30d92-7527-47da-9ea5-cf0e8a2710aa tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1731 microversion: 2.20 time: 0.158362 Sep 06 22:49:22.473405 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 424/840] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:49:22 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:49:22.530120 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7adb5664-c532-4d70-ae7f-c412911e6019 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:22.530755 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7adb5664-c532-4d70-ae7f-c412911e6019 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:22.536685 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7adb5664-c532-4d70-ae7f-c412911e6019 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:22.537197 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7adb5664-c532-4d70-ae7f-c412911e6019 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:22.537627 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7adb5664-c532-4d70-ae7f-c412911e6019 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:22.538308 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7adb5664-c532-4d70-ae7f-c412911e6019 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:22.538755 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7adb5664-c532-4d70-ae7f-c412911e6019 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:22.539169 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7adb5664-c532-4d70-ae7f-c412911e6019 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:22.669258 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7adb5664-c532-4d70-ae7f-c412911e6019 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:22.676921 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7adb5664-c532-4d70-ae7f-c412911e6019 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1576 microversion: 2.1 time: 0.151800 Sep 06 22:49:22.677481 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 417/841] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:22 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:22.902382 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-0d2cce03-8aa4-4f36-8ef2-5bde347b6f35 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:22.902987 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-0d2cce03-8aa4-4f36-8ef2-5bde347b6f35 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 5acd0d35-4bad-4c55-853d-767fec050879] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:22.908873 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0d2cce03-8aa4-4f36-8ef2-5bde347b6f35 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:22.909357 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0d2cce03-8aa4-4f36-8ef2-5bde347b6f35 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:22.909789 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0d2cce03-8aa4-4f36-8ef2-5bde347b6f35 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:22.910479 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0d2cce03-8aa4-4f36-8ef2-5bde347b6f35 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:22.910927 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0d2cce03-8aa4-4f36-8ef2-5bde347b6f35 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:22.911346 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0d2cce03-8aa4-4f36-8ef2-5bde347b6f35 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:23.050414 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-0d2cce03-8aa4-4f36-8ef2-5bde347b6f35 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:23.058925 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-0d2cce03-8aa4-4f36-8ef2-5bde347b6f35 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879" status: 200 len: 1266 microversion: 2.1 time: 0.160532 Sep 06 22:49:23.059488 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 425/842] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:22 2022] GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:23.078718 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0adaf8fc-7a4b-4ba1-8cd6-fbfb78fd569c tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:23.080230 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0adaf8fc-7a4b-4ba1-8cd6-fbfb78fd569c tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] [instance: e839f6fc-d10f-4c98-b6f4-9b16ed202d66] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:23.086813 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0adaf8fc-7a4b-4ba1-8cd6-fbfb78fd569c tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:23.087298 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0adaf8fc-7a4b-4ba1-8cd6-fbfb78fd569c tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:23.087741 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0adaf8fc-7a4b-4ba1-8cd6-fbfb78fd569c tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:23.088991 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0adaf8fc-7a4b-4ba1-8cd6-fbfb78fd569c tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:23.089434 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0adaf8fc-7a4b-4ba1-8cd6-fbfb78fd569c tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:23.089851 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0adaf8fc-7a4b-4ba1-8cd6-fbfb78fd569c tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:23.157559 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0adaf8fc-7a4b-4ba1-8cd6-fbfb78fd569c tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5593dc049144447859a48e458717295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3e57c72cec4c128a09749da5a90a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:23.165400 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0adaf8fc-7a4b-4ba1-8cd6-fbfb78fd569c tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] 10.222.0.39 "GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66" status: 200 len: 1218 microversion: 2.1 time: 0.091074 Sep 06 22:49:23.166045 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 418/843] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:23 2022] GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:23.498585 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6a9c3d62-46c6-49b6-a00a-64ee234e7971 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:23.499323 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-6a9c3d62-46c6-49b6-a00a-64ee234e7971 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:23.505721 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6a9c3d62-46c6-49b6-a00a-64ee234e7971 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:23.506202 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6a9c3d62-46c6-49b6-a00a-64ee234e7971 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:23.506631 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6a9c3d62-46c6-49b6-a00a-64ee234e7971 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:23.507312 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6a9c3d62-46c6-49b6-a00a-64ee234e7971 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:23.507758 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6a9c3d62-46c6-49b6-a00a-64ee234e7971 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:23.508178 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6a9c3d62-46c6-49b6-a00a-64ee234e7971 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:23.638801 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6a9c3d62-46c6-49b6-a00a-64ee234e7971 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:23.646777 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6a9c3d62-46c6-49b6-a00a-64ee234e7971 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:23.648206 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6a9c3d62-46c6-49b6-a00a-64ee234e7971 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:23.649367 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-6a9c3d62-46c6-49b6-a00a-64ee234e7971 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1731 microversion: 2.20 time: 0.155254 Sep 06 22:49:23.649910 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 426/844] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:49:23 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:49:23.700102 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6472a555-627c-4182-8348-a30d21f21bdb tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:23.700709 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6472a555-627c-4182-8348-a30d21f21bdb tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:23.706524 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6472a555-627c-4182-8348-a30d21f21bdb tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:23.707005 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6472a555-627c-4182-8348-a30d21f21bdb tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:23.707429 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6472a555-627c-4182-8348-a30d21f21bdb tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:23.708111 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6472a555-627c-4182-8348-a30d21f21bdb tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:23.708557 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6472a555-627c-4182-8348-a30d21f21bdb tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:23.709017 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6472a555-627c-4182-8348-a30d21f21bdb tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:23.834917 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-6472a555-627c-4182-8348-a30d21f21bdb tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:23.842679 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6472a555-627c-4182-8348-a30d21f21bdb tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1576 microversion: 2.1 time: 0.147150 Sep 06 22:49:23.843182 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 419/845] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:23 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1576 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:24.082962 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-df2686ec-2758-49fe-a126-044c273bf38b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:24.083787 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-df2686ec-2758-49fe-a126-044c273bf38b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 5acd0d35-4bad-4c55-853d-767fec050879] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:24.090409 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-df2686ec-2758-49fe-a126-044c273bf38b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:24.090892 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-df2686ec-2758-49fe-a126-044c273bf38b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:24.091336 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-df2686ec-2758-49fe-a126-044c273bf38b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:24.092064 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-df2686ec-2758-49fe-a126-044c273bf38b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:24.092565 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-df2686ec-2758-49fe-a126-044c273bf38b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:24.093071 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-df2686ec-2758-49fe-a126-044c273bf38b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:24.188906 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c9e2bcb3-be70-413d-ac8e-43eabf10585c tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:24.189517 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c9e2bcb3-be70-413d-ac8e-43eabf10585c tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] [instance: e839f6fc-d10f-4c98-b6f4-9b16ed202d66] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:24.200006 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c9e2bcb3-be70-413d-ac8e-43eabf10585c tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:24.200788 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c9e2bcb3-be70-413d-ac8e-43eabf10585c tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:24.201409 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c9e2bcb3-be70-413d-ac8e-43eabf10585c tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:24.202276 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c9e2bcb3-be70-413d-ac8e-43eabf10585c tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:24.202890 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c9e2bcb3-be70-413d-ac8e-43eabf10585c tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:24.203478 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c9e2bcb3-be70-413d-ac8e-43eabf10585c tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:24.294453 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-df2686ec-2758-49fe-a126-044c273bf38b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:24.295913 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c9e2bcb3-be70-413d-ac8e-43eabf10585c tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5593dc049144447859a48e458717295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3e57c72cec4c128a09749da5a90a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:24.305425 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c9e2bcb3-be70-413d-ac8e-43eabf10585c tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] 10.222.0.39 "GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66" status: 200 len: 1266 microversion: 2.1 time: 0.120485 Sep 06 22:49:24.306021 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 420/846] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:24 2022] GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66 => generated 1266 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:24.306940 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-df2686ec-2758-49fe-a126-044c273bf38b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879" status: 200 len: 1266 microversion: 2.1 time: 0.227796 Sep 06 22:49:24.320656 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 427/847] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:24 2022] GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879 => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:24.675399 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4aae504c-bd26-4c56-8deb-246b58cc4d92 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:24.676009 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4aae504c-bd26-4c56-8deb-246b58cc4d92 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:24.686629 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4aae504c-bd26-4c56-8deb-246b58cc4d92 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:24.687120 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4aae504c-bd26-4c56-8deb-246b58cc4d92 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:24.687551 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4aae504c-bd26-4c56-8deb-246b58cc4d92 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:24.688279 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4aae504c-bd26-4c56-8deb-246b58cc4d92 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:24.688714 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4aae504c-bd26-4c56-8deb-246b58cc4d92 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:24.689186 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4aae504c-bd26-4c56-8deb-246b58cc4d92 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:24.865912 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-bc68c786-ff68-43ab-be3d-1e7589d8d69d tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:24.866548 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-bc68c786-ff68-43ab-be3d-1e7589d8d69d tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:24.869044 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=2 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:24.875209 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bc68c786-ff68-43ab-be3d-1e7589d8d69d tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:24.877746 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bc68c786-ff68-43ab-be3d-1e7589d8d69d tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:24.877746 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bc68c786-ff68-43ab-be3d-1e7589d8d69d tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:24.877746 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bc68c786-ff68-43ab-be3d-1e7589d8d69d tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:24.877746 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bc68c786-ff68-43ab-be3d-1e7589d8d69d tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:24.878511 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bc68c786-ff68-43ab-be3d-1e7589d8d69d tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:25.066077 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4aae504c-bd26-4c56-8deb-246b58cc4d92 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:25.081634 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4aae504c-bd26-4c56-8deb-246b58cc4d92 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:25.083540 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4aae504c-bd26-4c56-8deb-246b58cc4d92 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:25.085729 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4aae504c-bd26-4c56-8deb-246b58cc4d92 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1731 microversion: 2.20 time: 0.414114 Sep 06 22:49:25.087307 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 421/848] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:49:24 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1731 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:49:25.176090 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-bc68c786-ff68-43ab-be3d-1e7589d8d69d tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:25.180155 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=8 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:25.186805 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-bc68c786-ff68-43ab-be3d-1e7589d8d69d tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1576 microversion: 2.1 time: 0.324644 Sep 06 22:49:25.187389 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 428/849] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:24 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1576 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:49:25.334160 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9678549c-1dda-4968-a544-8d9375434663 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:25.334538 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e3dcdfc4-4a90-4fdc-8b66-39ea2e42758d tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:25.335181 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9678549c-1dda-4968-a544-8d9375434663 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 5acd0d35-4bad-4c55-853d-767fec050879] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:25.335871 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e3dcdfc4-4a90-4fdc-8b66-39ea2e42758d tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] [instance: e839f6fc-d10f-4c98-b6f4-9b16ed202d66] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:25.342821 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9678549c-1dda-4968-a544-8d9375434663 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:25.343709 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9678549c-1dda-4968-a544-8d9375434663 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:25.344376 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9678549c-1dda-4968-a544-8d9375434663 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:25.345450 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9678549c-1dda-4968-a544-8d9375434663 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:25.345627 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3dcdfc4-4a90-4fdc-8b66-39ea2e42758d tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:25.346509 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3dcdfc4-4a90-4fdc-8b66-39ea2e42758d tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:25.346744 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9678549c-1dda-4968-a544-8d9375434663 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:25.347274 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9678549c-1dda-4968-a544-8d9375434663 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:25.347409 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3dcdfc4-4a90-4fdc-8b66-39ea2e42758d tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:25.347966 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3dcdfc4-4a90-4fdc-8b66-39ea2e42758d tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:25.349002 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3dcdfc4-4a90-4fdc-8b66-39ea2e42758d tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:25.349689 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e3dcdfc4-4a90-4fdc-8b66-39ea2e42758d tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:25.646065 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e3dcdfc4-4a90-4fdc-8b66-39ea2e42758d tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5593dc049144447859a48e458717295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3e57c72cec4c128a09749da5a90a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:25.652171 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9678549c-1dda-4968-a544-8d9375434663 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:25.657538 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e3dcdfc4-4a90-4fdc-8b66-39ea2e42758d tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] 10.222.0.39 "GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66" status: 200 len: 1314 microversion: 2.1 time: 0.327776 Sep 06 22:49:25.664457 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9678549c-1dda-4968-a544-8d9375434663 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879" status: 200 len: 1453 microversion: 2.1 time: 0.334346 Sep 06 22:49:25.669210 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 422/850] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:25 2022] GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66 => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:25.675754 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 429/851] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:25 2022] GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879 => generated 1453 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:25.689681 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7b422bbe-b6db-462e-9697-e357c00f83d4 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:25.691016 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7b422bbe-b6db-462e-9697-e357c00f83d4 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 5acd0d35-4bad-4c55-853d-767fec050879] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:25.696869 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7b422bbe-b6db-462e-9697-e357c00f83d4 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:25.697501 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7b422bbe-b6db-462e-9697-e357c00f83d4 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:25.698566 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7b422bbe-b6db-462e-9697-e357c00f83d4 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:25.699403 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7b422bbe-b6db-462e-9697-e357c00f83d4 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:25.699962 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7b422bbe-b6db-462e-9697-e357c00f83d4 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:25.700524 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7b422bbe-b6db-462e-9697-e357c00f83d4 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:25.913213 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7b422bbe-b6db-462e-9697-e357c00f83d4 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:25.927789 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7b422bbe-b6db-462e-9697-e357c00f83d4 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879" status: 200 len: 1453 microversion: 2.1 time: 0.242617 Sep 06 22:49:25.928695 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 423/852] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:25 2022] GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879 => generated 1453 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:49:26.097414 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-450b7aee-ff87-47e1-b06a-3d9b30432f6c req-f8b63909-c30a-4356-949c-a5d27ef6615f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43a8e21a-339a-4ea5-ad07-4d74e92be9de", "name": "network-vif-plugged", "status": "completed", "tag": "1501f706-7e9c-4f45-b83a-b0e52d8d1f26"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:49:26.113508 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ac9a7b02-7db9-4585-b12b-8bfa21417720 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:26.114216 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ac9a7b02-7db9-4585-b12b-8bfa21417720 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:26.116797 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-450b7aee-ff87-47e1-b06a-3d9b30432f6c req-f8b63909-c30a-4356-949c-a5d27ef6615f service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:26.117322 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-450b7aee-ff87-47e1-b06a-3d9b30432f6c req-f8b63909-c30a-4356-949c-a5d27ef6615f service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:26.117747 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-450b7aee-ff87-47e1-b06a-3d9b30432f6c req-f8b63909-c30a-4356-949c-a5d27ef6615f service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:26.124110 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac9a7b02-7db9-4585-b12b-8bfa21417720 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:26.124620 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac9a7b02-7db9-4585-b12b-8bfa21417720 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:26.126789 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac9a7b02-7db9-4585-b12b-8bfa21417720 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:26.127790 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac9a7b02-7db9-4585-b12b-8bfa21417720 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:26.130482 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac9a7b02-7db9-4585-b12b-8bfa21417720 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:26.131586 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ac9a7b02-7db9-4585-b12b-8bfa21417720 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:26.143708 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-450b7aee-ff87-47e1-b06a-3d9b30432f6c req-f8b63909-c30a-4356-949c-a5d27ef6615f service nova] Creating event network-vif-plugged:1501f706-7e9c-4f45-b83a-b0e52d8d1f26 for instance 43a8e21a-339a-4ea5-ad07-4d74e92be9de on hv-cinder-85220 Sep 06 22:49:26.154652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-450b7aee-ff87-47e1-b06a-3d9b30432f6c req-f8b63909-c30a-4356-949c-a5d27ef6615f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060976 Sep 06 22:49:26.157111 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 430/853] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:49:26.213485 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d27051bc-15e6-48ce-a396-993ee63606d1 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:26.214388 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-d27051bc-15e6-48ce-a396-993ee63606d1 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:26.232185 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d27051bc-15e6-48ce-a396-993ee63606d1 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:26.234396 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d27051bc-15e6-48ce-a396-993ee63606d1 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:26.235002 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d27051bc-15e6-48ce-a396-993ee63606d1 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:26.237733 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d27051bc-15e6-48ce-a396-993ee63606d1 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:26.238384 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d27051bc-15e6-48ce-a396-993ee63606d1 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:26.240028 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d27051bc-15e6-48ce-a396-993ee63606d1 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:26.824983 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ac9a7b02-7db9-4585-b12b-8bfa21417720 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:26.840185 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ac9a7b02-7db9-4585-b12b-8bfa21417720 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:26.843309 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ac9a7b02-7db9-4585-b12b-8bfa21417720 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:26.844586 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ac9a7b02-7db9-4585-b12b-8bfa21417720 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1731 microversion: 2.20 time: 0.736012 Sep 06 22:49:26.845638 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 424/854] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:49:26 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1731 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:49:26.852611 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1168700e-cc66-4489-8009-5d9b5208de97 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:26.853427 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1168700e-cc66-4489-8009-5d9b5208de97 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] [instance: e839f6fc-d10f-4c98-b6f4-9b16ed202d66] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:26.863867 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1168700e-cc66-4489-8009-5d9b5208de97 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:26.864794 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1168700e-cc66-4489-8009-5d9b5208de97 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:26.865611 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1168700e-cc66-4489-8009-5d9b5208de97 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:26.866521 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1168700e-cc66-4489-8009-5d9b5208de97 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:26.867135 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1168700e-cc66-4489-8009-5d9b5208de97 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:26.868080 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1168700e-cc66-4489-8009-5d9b5208de97 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:26.921369 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-d27051bc-15e6-48ce-a396-993ee63606d1 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:26.929213 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d27051bc-15e6-48ce-a396-993ee63606d1 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1576 microversion: 2.1 time: 0.721364 Sep 06 22:49:26.929799 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 431/855] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:26 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1576 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:27.128517 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-377705b3-7896-4215-9a87-ed10846f1ecb req-7a36bbf8-eaf3-41b8-85c9-99dc2da96bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e839f6fc-d10f-4c98-b6f4-9b16ed202d66", "tag": "56e2e6e5-93a4-446f-9ba7-e587addae8dd"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:49:27.133474 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-1168700e-cc66-4489-8009-5d9b5208de97 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5593dc049144447859a48e458717295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3e57c72cec4c128a09749da5a90a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:27.148470 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1168700e-cc66-4489-8009-5d9b5208de97 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] 10.222.0.39 "GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66" status: 200 len: 1314 microversion: 2.1 time: 0.299262 Sep 06 22:49:27.148778 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-377705b3-7896-4215-9a87-ed10846f1ecb req-7a36bbf8-eaf3-41b8-85c9-99dc2da96bb3 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:27.149618 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-377705b3-7896-4215-9a87-ed10846f1ecb req-7a36bbf8-eaf3-41b8-85c9-99dc2da96bb3 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:27.153346 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-377705b3-7896-4215-9a87-ed10846f1ecb req-7a36bbf8-eaf3-41b8-85c9-99dc2da96bb3 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:27.168092 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 425/856] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:26 2022] GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:27.168964 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-377705b3-7896-4215-9a87-ed10846f1ecb req-7a36bbf8-eaf3-41b8-85c9-99dc2da96bb3 service nova] Creating event network-changed:56e2e6e5-93a4-446f-9ba7-e587addae8dd for instance e839f6fc-d10f-4c98-b6f4-9b16ed202d66 on hv-cinder-85220 Sep 06 22:49:27.174442 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-377705b3-7896-4215-9a87-ed10846f1ecb req-7a36bbf8-eaf3-41b8-85c9-99dc2da96bb3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052001 Sep 06 22:49:27.175594 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 432/857] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 22:49:27.876591 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-89ce94c2-946e-4197-9c1b-694b26f73740 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:27.878239 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-89ce94c2-946e-4197-9c1b-694b26f73740 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:27.886913 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89ce94c2-946e-4197-9c1b-694b26f73740 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:27.887734 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89ce94c2-946e-4197-9c1b-694b26f73740 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:27.888589 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89ce94c2-946e-4197-9c1b-694b26f73740 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:27.890267 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89ce94c2-946e-4197-9c1b-694b26f73740 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:27.890919 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89ce94c2-946e-4197-9c1b-694b26f73740 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:27.891688 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-89ce94c2-946e-4197-9c1b-694b26f73740 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:27.952363 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d41bc856-d14f-400f-9a5e-a1288803c204 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:27.953944 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-d41bc856-d14f-400f-9a5e-a1288803c204 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:27.964057 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d41bc856-d14f-400f-9a5e-a1288803c204 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:27.967334 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d41bc856-d14f-400f-9a5e-a1288803c204 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:27.967870 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d41bc856-d14f-400f-9a5e-a1288803c204 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:27.968675 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d41bc856-d14f-400f-9a5e-a1288803c204 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:27.969172 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d41bc856-d14f-400f-9a5e-a1288803c204 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:27.969803 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d41bc856-d14f-400f-9a5e-a1288803c204 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:28.158794 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-89ce94c2-946e-4197-9c1b-694b26f73740 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:28.174094 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-89ce94c2-946e-4197-9c1b-694b26f73740 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:28.176716 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-89ce94c2-946e-4197-9c1b-694b26f73740 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:28.179677 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-89ce94c2-946e-4197-9c1b-694b26f73740 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1731 microversion: 2.20 time: 0.307416 Sep 06 22:49:28.181032 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 426/858] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:49:27 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1731 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:49:28.187089 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-d41bc856-d14f-400f-9a5e-a1288803c204 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:28.200345 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a6127341-e4d8-4a54-9143-e429e60cf9a8 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:28.202919 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d41bc856-d14f-400f-9a5e-a1288803c204 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1563 microversion: 2.1 time: 0.254987 Sep 06 22:49:28.203152 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a6127341-e4d8-4a54-9143-e429e60cf9a8 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] [instance: e839f6fc-d10f-4c98-b6f4-9b16ed202d66] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:28.203521 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 433/859] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:27 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1563 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:28.209033 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-a9d04ce5-1f16-4c77-ac6d-556100cb4535 req-f995d668-8fd5-40bc-bf30-921f6569c8c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c781a9d5-f194-47b8-870d-eab1adcc1ad5", "name": "network-vif-plugged", "status": "completed", "tag": "e9150456-138e-49eb-8d2d-f86cecea4bae"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:49:28.212239 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a6127341-e4d8-4a54-9143-e429e60cf9a8 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:28.212735 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a6127341-e4d8-4a54-9143-e429e60cf9a8 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:28.213941 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a6127341-e4d8-4a54-9143-e429e60cf9a8 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:28.214593 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a6127341-e4d8-4a54-9143-e429e60cf9a8 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:28.215375 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a6127341-e4d8-4a54-9143-e429e60cf9a8 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:28.215888 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a6127341-e4d8-4a54-9143-e429e60cf9a8 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:28.223524 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-a9d04ce5-1f16-4c77-ac6d-556100cb4535 req-f995d668-8fd5-40bc-bf30-921f6569c8c8 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:28.224082 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-a9d04ce5-1f16-4c77-ac6d-556100cb4535 req-f995d668-8fd5-40bc-bf30-921f6569c8c8 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:28.224535 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-a9d04ce5-1f16-4c77-ac6d-556100cb4535 req-f995d668-8fd5-40bc-bf30-921f6569c8c8 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:28.253999 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-a9d04ce5-1f16-4c77-ac6d-556100cb4535 req-f995d668-8fd5-40bc-bf30-921f6569c8c8 service nova] Creating event network-vif-plugged:e9150456-138e-49eb-8d2d-f86cecea4bae for instance c781a9d5-f194-47b8-870d-eab1adcc1ad5 on hv-cinder-85220 Sep 06 22:49:28.269015 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-a9d04ce5-1f16-4c77-ac6d-556100cb4535 req-f995d668-8fd5-40bc-bf30-921f6569c8c8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064173 Sep 06 22:49:28.272921 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 434/860] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:49:28.285996 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-754c5341-6627-45de-b307-e9ffb92c0bd4 req-3af62fe7-249e-413b-b25c-7677eef20ddb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5acd0d35-4bad-4c55-853d-767fec050879", "tag": "5283334a-d586-42df-ac4b-7eae8c83bfd3"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:49:28.308884 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-754c5341-6627-45de-b307-e9ffb92c0bd4 req-3af62fe7-249e-413b-b25c-7677eef20ddb service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:28.309772 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-754c5341-6627-45de-b307-e9ffb92c0bd4 req-3af62fe7-249e-413b-b25c-7677eef20ddb service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:28.310497 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-754c5341-6627-45de-b307-e9ffb92c0bd4 req-3af62fe7-249e-413b-b25c-7677eef20ddb service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:28.341400 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-754c5341-6627-45de-b307-e9ffb92c0bd4 req-3af62fe7-249e-413b-b25c-7677eef20ddb service nova] Creating event network-changed:5283334a-d586-42df-ac4b-7eae8c83bfd3 for instance 5acd0d35-4bad-4c55-853d-767fec050879 on hv-cinder-85220 Sep 06 22:49:28.350580 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-754c5341-6627-45de-b307-e9ffb92c0bd4 req-3af62fe7-249e-413b-b25c-7677eef20ddb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075204 Sep 06 22:49:28.351820 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 435/861] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:49:28.599469 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a6127341-e4d8-4a54-9143-e429e60cf9a8 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5593dc049144447859a48e458717295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3e57c72cec4c128a09749da5a90a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:28.608304 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a6127341-e4d8-4a54-9143-e429e60cf9a8 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] 10.222.0.39 "GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66" status: 200 len: 1314 microversion: 2.1 time: 0.425979 Sep 06 22:49:28.609659 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 427/862] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:28 2022] GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66 => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:29.208092 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d5f4a296-c384-43d4-95f5-a7d712357754 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:29.208952 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-d5f4a296-c384-43d4-95f5-a7d712357754 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:29.217131 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d5f4a296-c384-43d4-95f5-a7d712357754 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:29.217791 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d5f4a296-c384-43d4-95f5-a7d712357754 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:29.218465 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d5f4a296-c384-43d4-95f5-a7d712357754 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:29.219307 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d5f4a296-c384-43d4-95f5-a7d712357754 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:29.219830 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d5f4a296-c384-43d4-95f5-a7d712357754 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:29.220258 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d5f4a296-c384-43d4-95f5-a7d712357754 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:29.375172 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-d5f4a296-c384-43d4-95f5-a7d712357754 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:29.383528 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-d5f4a296-c384-43d4-95f5-a7d712357754 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:29.385271 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-d5f4a296-c384-43d4-95f5-a7d712357754 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:29.387150 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d5f4a296-c384-43d4-95f5-a7d712357754 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1731 microversion: 2.20 time: 0.183124 Sep 06 22:49:29.388338 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 436/863] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:49:29 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:49:29.631471 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-64f0afcd-f1fd-4441-a251-aec088925995 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:29.633033 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-64f0afcd-f1fd-4441-a251-aec088925995 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] [instance: e839f6fc-d10f-4c98-b6f4-9b16ed202d66] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:29.640072 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-64f0afcd-f1fd-4441-a251-aec088925995 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:29.640564 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-64f0afcd-f1fd-4441-a251-aec088925995 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:29.641044 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-64f0afcd-f1fd-4441-a251-aec088925995 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:29.641745 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-64f0afcd-f1fd-4441-a251-aec088925995 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:29.642197 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-64f0afcd-f1fd-4441-a251-aec088925995 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:29.642622 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-64f0afcd-f1fd-4441-a251-aec088925995 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:29.815701 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-64f0afcd-f1fd-4441-a251-aec088925995 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5593dc049144447859a48e458717295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3e57c72cec4c128a09749da5a90a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:29.824114 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-64f0afcd-f1fd-4441-a251-aec088925995 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] 10.222.0.39 "GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66" status: 200 len: 1314 microversion: 2.1 time: 0.197393 Sep 06 22:49:29.824684 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 428/864] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:29 2022] GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:30.416106 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-31f5c7f8-5c91-4a30-bc4b-55a4d03afe68 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:30.417176 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-31f5c7f8-5c91-4a30-bc4b-55a4d03afe68 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:30.425626 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-31f5c7f8-5c91-4a30-bc4b-55a4d03afe68 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:30.426231 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-31f5c7f8-5c91-4a30-bc4b-55a4d03afe68 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:30.426737 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-31f5c7f8-5c91-4a30-bc4b-55a4d03afe68 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:30.427626 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-31f5c7f8-5c91-4a30-bc4b-55a4d03afe68 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:30.428085 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-31f5c7f8-5c91-4a30-bc4b-55a4d03afe68 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:30.428511 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-31f5c7f8-5c91-4a30-bc4b-55a4d03afe68 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:30.593686 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-31f5c7f8-5c91-4a30-bc4b-55a4d03afe68 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:30.602905 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-31f5c7f8-5c91-4a30-bc4b-55a4d03afe68 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:30.605067 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-31f5c7f8-5c91-4a30-bc4b-55a4d03afe68 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:30.606488 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-31f5c7f8-5c91-4a30-bc4b-55a4d03afe68 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1731 microversion: 2.20 time: 0.194414 Sep 06 22:49:30.607845 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 437/865] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:49:30 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1731 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:49:30.846041 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9da7262d-0140-48eb-b8c1-7e075a917b06 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:30.847348 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9da7262d-0140-48eb-b8c1-7e075a917b06 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] [instance: e839f6fc-d10f-4c98-b6f4-9b16ed202d66] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:30.856835 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9da7262d-0140-48eb-b8c1-7e075a917b06 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:30.857554 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9da7262d-0140-48eb-b8c1-7e075a917b06 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:30.858161 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9da7262d-0140-48eb-b8c1-7e075a917b06 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:30.859189 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9da7262d-0140-48eb-b8c1-7e075a917b06 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:30.859945 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9da7262d-0140-48eb-b8c1-7e075a917b06 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:30.860521 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9da7262d-0140-48eb-b8c1-7e075a917b06 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:31.010461 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9da7262d-0140-48eb-b8c1-7e075a917b06 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5593dc049144447859a48e458717295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3e57c72cec4c128a09749da5a90a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:31.019155 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9da7262d-0140-48eb-b8c1-7e075a917b06 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] 10.222.0.39 "GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66" status: 200 len: 1314 microversion: 2.1 time: 0.176998 Sep 06 22:49:31.019733 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 429/866] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:30 2022] GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:31.631968 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-60df56a7-6ec7-4193-bab3-15d7866a7427 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:31.632602 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-60df56a7-6ec7-4193-bab3-15d7866a7427 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:31.639159 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-60df56a7-6ec7-4193-bab3-15d7866a7427 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:31.639641 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-60df56a7-6ec7-4193-bab3-15d7866a7427 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:31.640066 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-60df56a7-6ec7-4193-bab3-15d7866a7427 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:31.640747 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-60df56a7-6ec7-4193-bab3-15d7866a7427 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:31.641214 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-60df56a7-6ec7-4193-bab3-15d7866a7427 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:31.641630 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-60df56a7-6ec7-4193-bab3-15d7866a7427 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:31.777967 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-60df56a7-6ec7-4193-bab3-15d7866a7427 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:31.780256 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=100 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:31.787526 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-60df56a7-6ec7-4193-bab3-15d7866a7427 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:31.789007 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-60df56a7-6ec7-4193-bab3-15d7866a7427 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:31.790160 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-60df56a7-6ec7-4193-bab3-15d7866a7427 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1718 microversion: 2.20 time: 0.162018 Sep 06 22:49:31.790716 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 438/867] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:49:31 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1718 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:49:32.044671 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-60796e4b-81de-4eeb-a08e-b0113618f6cd tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:32.045351 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-60796e4b-81de-4eeb-a08e-b0113618f6cd tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] [instance: e839f6fc-d10f-4c98-b6f4-9b16ed202d66] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:32.052780 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-60796e4b-81de-4eeb-a08e-b0113618f6cd tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:32.053297 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-60796e4b-81de-4eeb-a08e-b0113618f6cd tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:32.053733 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-60796e4b-81de-4eeb-a08e-b0113618f6cd tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:32.054432 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-60796e4b-81de-4eeb-a08e-b0113618f6cd tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:32.054883 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-60796e4b-81de-4eeb-a08e-b0113618f6cd tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:32.055303 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-60796e4b-81de-4eeb-a08e-b0113618f6cd tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:32.078538 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-026fd438-64bf-4403-bcb0-8777918650e5 req-26a8da67-f0dd-4c58-a69f-fb9a073817c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e839f6fc-d10f-4c98-b6f4-9b16ed202d66", "name": "network-vif-plugged", "status": "completed", "tag": "56e2e6e5-93a4-446f-9ba7-e587addae8dd"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:49:32.091429 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-026fd438-64bf-4403-bcb0-8777918650e5 req-26a8da67-f0dd-4c58-a69f-fb9a073817c6 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:32.092248 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-026fd438-64bf-4403-bcb0-8777918650e5 req-26a8da67-f0dd-4c58-a69f-fb9a073817c6 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:32.093009 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-026fd438-64bf-4403-bcb0-8777918650e5 req-26a8da67-f0dd-4c58-a69f-fb9a073817c6 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:32.107248 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-026fd438-64bf-4403-bcb0-8777918650e5 req-26a8da67-f0dd-4c58-a69f-fb9a073817c6 service nova] Creating event network-vif-plugged:56e2e6e5-93a4-446f-9ba7-e587addae8dd for instance e839f6fc-d10f-4c98-b6f4-9b16ed202d66 on hv-cinder-85220 Sep 06 22:49:32.112935 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-026fd438-64bf-4403-bcb0-8777918650e5 req-26a8da67-f0dd-4c58-a69f-fb9a073817c6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040182 Sep 06 22:49:32.113730 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 439/868] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 22:49:32.225598 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-60796e4b-81de-4eeb-a08e-b0113618f6cd tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5593dc049144447859a48e458717295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3e57c72cec4c128a09749da5a90a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:32.234149 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-60796e4b-81de-4eeb-a08e-b0113618f6cd tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] 10.222.0.39 "GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66" status: 200 len: 1314 microversion: 2.1 time: 0.195275 Sep 06 22:49:32.244790 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 430/869] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:32 2022] GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:33.257442 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-c6506080-d4b1-47c2-b7c9-2b139dd2d421 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:33.258425 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-c6506080-d4b1-47c2-b7c9-2b139dd2d421 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] [instance: e839f6fc-d10f-4c98-b6f4-9b16ed202d66] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:33.265493 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c6506080-d4b1-47c2-b7c9-2b139dd2d421 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:33.266012 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c6506080-d4b1-47c2-b7c9-2b139dd2d421 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:33.266451 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c6506080-d4b1-47c2-b7c9-2b139dd2d421 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:33.267129 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c6506080-d4b1-47c2-b7c9-2b139dd2d421 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:33.267577 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c6506080-d4b1-47c2-b7c9-2b139dd2d421 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:33.267995 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c6506080-d4b1-47c2-b7c9-2b139dd2d421 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:33.395978 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-c6506080-d4b1-47c2-b7c9-2b139dd2d421 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5593dc049144447859a48e458717295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3e57c72cec4c128a09749da5a90a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:33.404034 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-c6506080-d4b1-47c2-b7c9-2b139dd2d421 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] 10.222.0.39 "GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66" status: 200 len: 1314 microversion: 2.1 time: 0.151534 Sep 06 22:49:33.404603 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 440/870] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:33 2022] GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:34.426728 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f7d5f0f4-50ea-4c8a-b505-5ac4dd9ef8b9 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:34.427388 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f7d5f0f4-50ea-4c8a-b505-5ac4dd9ef8b9 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] [instance: e839f6fc-d10f-4c98-b6f4-9b16ed202d66] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:34.434733 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f7d5f0f4-50ea-4c8a-b505-5ac4dd9ef8b9 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:34.435211 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f7d5f0f4-50ea-4c8a-b505-5ac4dd9ef8b9 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:34.435644 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f7d5f0f4-50ea-4c8a-b505-5ac4dd9ef8b9 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:34.436331 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f7d5f0f4-50ea-4c8a-b505-5ac4dd9ef8b9 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:34.436811 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f7d5f0f4-50ea-4c8a-b505-5ac4dd9ef8b9 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:34.437231 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f7d5f0f4-50ea-4c8a-b505-5ac4dd9ef8b9 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:34.571999 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f7d5f0f4-50ea-4c8a-b505-5ac4dd9ef8b9 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5593dc049144447859a48e458717295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3e57c72cec4c128a09749da5a90a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:34.580434 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f7d5f0f4-50ea-4c8a-b505-5ac4dd9ef8b9 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] 10.222.0.39 "GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66" status: 200 len: 1498 microversion: 2.1 time: 0.157610 Sep 06 22:49:34.581032 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 431/871] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:34 2022] GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66 => generated 1498 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:36.854209 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-4b0f6766-e732-4061-b35a-9e2e7b6bb447 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:36.854750 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-4b0f6766-e732-4061-b35a-9e2e7b6bb447 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] [instance: e839f6fc-d10f-4c98-b6f4-9b16ed202d66] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:36.861836 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4b0f6766-e732-4061-b35a-9e2e7b6bb447 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:36.862322 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4b0f6766-e732-4061-b35a-9e2e7b6bb447 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:36.862752 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4b0f6766-e732-4061-b35a-9e2e7b6bb447 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:36.863441 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4b0f6766-e732-4061-b35a-9e2e7b6bb447 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:36.863891 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4b0f6766-e732-4061-b35a-9e2e7b6bb447 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:36.864422 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4b0f6766-e732-4061-b35a-9e2e7b6bb447 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:36.892054 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-4b0f6766-e732-4061-b35a-9e2e7b6bb447 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] [instance: e839f6fc-d10f-4c98-b6f4-9b16ed202d66] Going to try to terminate instance {{(pid=127087) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 22:49:36.973511 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:36.990727 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-4b0f6766-e732-4061-b35a-9e2e7b6bb447 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66" status: 204 len: 0 microversion: 2.1 time: 0.139965 Sep 06 22:49:36.991511 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 441/872] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Sep 6 22:49:36 2022] DELETE /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 22:49:37.001125 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0cb8ae59-146f-43a4-9467-d9921e94b126 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:37.001752 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0cb8ae59-146f-43a4-9467-d9921e94b126 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] [instance: e839f6fc-d10f-4c98-b6f4-9b16ed202d66] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:37.008668 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0cb8ae59-146f-43a4-9467-d9921e94b126 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:37.009184 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0cb8ae59-146f-43a4-9467-d9921e94b126 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:37.009616 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0cb8ae59-146f-43a4-9467-d9921e94b126 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:37.010306 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0cb8ae59-146f-43a4-9467-d9921e94b126 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:37.010752 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0cb8ae59-146f-43a4-9467-d9921e94b126 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:37.011272 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0cb8ae59-146f-43a4-9467-d9921e94b126 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:37.305504 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0cb8ae59-146f-43a4-9467-d9921e94b126 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5593dc049144447859a48e458717295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3e57c72cec4c128a09749da5a90a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:37.315427 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0cb8ae59-146f-43a4-9467-d9921e94b126 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] 10.222.0.39 "GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66" status: 200 len: 1504 microversion: 2.1 time: 0.318736 Sep 06 22:49:37.316164 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 432/873] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:36 2022] GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66 => generated 1504 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:38.340959 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-c9da919f-6569-4f07-be77-3614126e0ffa tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:38.341653 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-c9da919f-6569-4f07-be77-3614126e0ffa tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] [instance: e839f6fc-d10f-4c98-b6f4-9b16ed202d66] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:38.348956 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c9da919f-6569-4f07-be77-3614126e0ffa tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:38.349425 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c9da919f-6569-4f07-be77-3614126e0ffa tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:38.349846 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c9da919f-6569-4f07-be77-3614126e0ffa tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:38.350520 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c9da919f-6569-4f07-be77-3614126e0ffa tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:38.350957 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c9da919f-6569-4f07-be77-3614126e0ffa tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:38.351361 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c9da919f-6569-4f07-be77-3614126e0ffa tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:38.498395 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-c9da919f-6569-4f07-be77-3614126e0ffa tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5593dc049144447859a48e458717295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3e57c72cec4c128a09749da5a90a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:38.506760 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-c9da919f-6569-4f07-be77-3614126e0ffa tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] 10.222.0.39 "GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66" status: 200 len: 1504 microversion: 2.1 time: 0.170712 Sep 06 22:49:38.507330 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 442/874] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:38 2022] GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66 => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:38.956902 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-3475e2aa-b89d-48d5-a726-e3586eda4262 req-6d11e775-6c10-4688-acba-7ee6cea2d25c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e839f6fc-d10f-4c98-b6f4-9b16ed202d66", "name": "network-vif-deleted", "tag": "56e2e6e5-93a4-446f-9ba7-e587addae8dd"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:49:38.967445 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-3475e2aa-b89d-48d5-a726-e3586eda4262 req-6d11e775-6c10-4688-acba-7ee6cea2d25c service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:38.967960 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-3475e2aa-b89d-48d5-a726-e3586eda4262 req-6d11e775-6c10-4688-acba-7ee6cea2d25c service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:38.968383 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-3475e2aa-b89d-48d5-a726-e3586eda4262 req-6d11e775-6c10-4688-acba-7ee6cea2d25c service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:38.970959 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=100 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:38.981078 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-3475e2aa-b89d-48d5-a726-e3586eda4262 req-6d11e775-6c10-4688-acba-7ee6cea2d25c service nova] Creating event network-vif-deleted:56e2e6e5-93a4-446f-9ba7-e587addae8dd for instance e839f6fc-d10f-4c98-b6f4-9b16ed202d66 on hv-cinder-85220 Sep 06 22:49:38.986630 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-3475e2aa-b89d-48d5-a726-e3586eda4262 req-6d11e775-6c10-4688-acba-7ee6cea2d25c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033414 Sep 06 22:49:38.987199 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 433/875] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:49:39.531032 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9b75b6e7-ec2a-4d51-af15-80332f701195 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:39.531688 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9b75b6e7-ec2a-4d51-af15-80332f701195 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] [instance: e839f6fc-d10f-4c98-b6f4-9b16ed202d66] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:39.538294 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9b75b6e7-ec2a-4d51-af15-80332f701195 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:39.538895 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9b75b6e7-ec2a-4d51-af15-80332f701195 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:39.539332 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9b75b6e7-ec2a-4d51-af15-80332f701195 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:39.540300 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9b75b6e7-ec2a-4d51-af15-80332f701195 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:39.540689 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9b75b6e7-ec2a-4d51-af15-80332f701195 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:39.541163 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9b75b6e7-ec2a-4d51-af15-80332f701195 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:39.579722 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9b75b6e7-ec2a-4d51-af15-80332f701195 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:39.580460 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9b75b6e7-ec2a-4d51-af15-80332f701195 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:39.581103 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9b75b6e7-ec2a-4d51-af15-80332f701195 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:39.582180 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.objects.instance [None req-9b75b6e7-ec2a-4d51-af15-80332f701195 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lazy-loading 'fault' on Instance uuid e839f6fc-d10f-4c98-b6f4-9b16ed202d66 {{(pid=127087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 22:49:39.640532 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9b75b6e7-ec2a-4d51-af15-80332f701195 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5593dc049144447859a48e458717295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3e57c72cec4c128a09749da5a90a5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:49:39.647880 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9b75b6e7-ec2a-4d51-af15-80332f701195 tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] 10.222.0.39 "GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66" status: 200 len: 1304 microversion: 2.1 time: 0.121764 Sep 06 22:49:39.648603 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 443/876] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:39 2022] GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66 => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:49:40.674310 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-df1e9f59-17dc-4959-a813-7da3696d32fa tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:49:40.675016 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-df1e9f59-17dc-4959-a813-7da3696d32fa tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] [instance: e839f6fc-d10f-4c98-b6f4-9b16ed202d66] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:49:40.677101 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=79 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:49:40.682658 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df1e9f59-17dc-4959-a813-7da3696d32fa tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:40.683907 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df1e9f59-17dc-4959-a813-7da3696d32fa tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:40.684346 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df1e9f59-17dc-4959-a813-7da3696d32fa tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:40.685384 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df1e9f59-17dc-4959-a813-7da3696d32fa tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:49:40.686175 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df1e9f59-17dc-4959-a813-7da3696d32fa tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:49:40.686782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-df1e9f59-17dc-4959-a813-7da3696d32fa tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:49:40.701864 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-df1e9f59-17dc-4959-a813-7da3696d32fa tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] HTTP exception thrown: Instance e839f6fc-d10f-4c98-b6f4-9b16ed202d66 could not be found. Sep 06 22:49:40.703547 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-df1e9f59-17dc-4959-a813-7da3696d32fa tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Request method failure captured: Sep 06 22:49:40.703547 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66 HTTP/1.1 Sep 06 22:49:40.703547 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept: application/json Sep 06 22:49:40.703547 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Sep 06 22:49:40.703547 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Connection: close Sep 06 22:49:40.703547 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Length: 0 Sep 06 22:49:40.703547 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Type: application/json Sep 06 22:49:40.703547 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Host: 10.222.0.39 Sep 06 22:49:40.703547 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Sep 06 22:49:40.703547 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Sep 06 22:49:40.703547 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjF85VcLSdc79Exi4mKn_ISoOQ0IjCyK2LhqY563HKfPT5h7hHLy3e8pMqh-inyyoS7rjAhfIbf2eRxvwPlFpTZZS-v6PBEYR1M2ws2jgjrqSw7-UPMv0PbykZQzX70UaMNKRBPpSLXblBdUMDSNi9OrKx-XP7m2gJ0YWeWiMWf7mactY Sep 06 22:49:40.703547 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Sep 06 22:49:40.703547 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Sep 06 22:49:40.703547 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Sep 06 22:49:40.703547 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Sep 06 22:49:40.703547 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Sep 06 22:49:40.703547 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Sep 06 22:49:40.703547 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Id: 9b3e57c72cec4c128a09749da5a90a5d Sep 06 22:49:40.703547 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-VolumesActionsTest-1712756567 Sep 06 22:49:40.703547 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Role: reader,member Sep 06 22:49:40.703547 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Sep 06 22:49:40.705042 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9b3e57c72cec4c128a09749da5a90a5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9b3e57c72cec4c128a09749da5a90a5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9b3e57c72cec4c128a09749da5a90a5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9b3e57c72cec4c128a09749da5a90a5d"}]}] Sep 06 22:49:40.705042 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-VolumesActionsTest-1712756567 Sep 06 22:49:40.705042 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 9b3e57c72cec4c128a09749da5a90a5d Sep 06 22:49:40.705042 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-VolumesActionsTest-1712756567 Sep 06 22:49:40.705042 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User: tempest-VolumesActionsTest-1712756567-project Sep 06 22:49:40.705042 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Sep 06 22:49:40.705042 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Sep 06 22:49:40.705042 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Id: e5593dc049144447859a48e458717295 Sep 06 22:49:40.705042 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-VolumesActionsTest-1712756567-project Sep 06 22:49:40.705042 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: method: > Sep 06 22:49:40.705042 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: exception: Instance e839f6fc-d10f-4c98-b6f4-9b16ed202d66 could not be found. Sep 06 22:49:40.705042 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: action_args: {'id': 'e839f6fc-d10f-4c98-b6f4-9b16ed202d66'} Sep 06 22:49:40.705823 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:49:40.705823 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:40.705823 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:49:40.705823 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:49:40.705823 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:49:40.705823 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:49:40.705823 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:49:40.705823 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:49:40.705823 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:49:40.705823 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:49:40.705823 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e839f6fc-d10f-4c98-b6f4-9b16ed202d66 could not be found. Sep 06 22:49:40.705823 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:49:40.705823 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:49:40.705823 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:49:40.705823 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:40.705823 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:49:40.705823 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:49:40.705823 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:49:40.705823 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:49:40.705823 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:49:40.707925 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:49:40.707925 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 22:49:40.707925 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 22:49:40.707925 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:49:40.707925 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:49:40.707925 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:49:40.707925 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:49:40.707925 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e839f6fc-d10f-4c98-b6f4-9b16ed202d66 could not be found. Sep 06 22:49:40.707925 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:49:40.707925 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:49:40.707925 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:49:40.707925 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:49:40.707925 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:49:40.707925 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:49:40.707925 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:49:40.707925 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:49:40.707925 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e839f6fc-d10f-4c98-b6f4-9b16ed202d66 could not be found. Sep 06 22:49:40.707925 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:49:40.709868 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-df1e9f59-17dc-4959-a813-7da3696d32fa tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] Returning 404 to user: Instance e839f6fc-d10f-4c98-b6f4-9b16ed202d66 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:49:40.709868 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-df1e9f59-17dc-4959-a813-7da3696d32fa tempest-VolumesActionsTest-1712756567 tempest-VolumesActionsTest-1712756567-project] 10.222.0.39 "GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66" status: 404 len: 111 microversion: 2.1 time: 0.036212 Sep 06 22:49:40.709868 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 434/877] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:49:40 2022] GET /compute/v2.1/servers/e839f6fc-d10f-4c98-b6f4-9b16ed202d66 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 22:50:13.374698 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ea9d69bd-6b8e-470b-9ac7-349be991841d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:50:13.377044 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ea9d69bd-6b8e-470b-9ac7-349be991841d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:50:13.379636 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:13.380295 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:13.386144 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ea9d69bd-6b8e-470b-9ac7-349be991841d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:13.386628 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ea9d69bd-6b8e-470b-9ac7-349be991841d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:13.387056 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ea9d69bd-6b8e-470b-9ac7-349be991841d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:13.387755 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ea9d69bd-6b8e-470b-9ac7-349be991841d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:13.388202 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ea9d69bd-6b8e-470b-9ac7-349be991841d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:13.388618 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ea9d69bd-6b8e-470b-9ac7-349be991841d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:13.423767 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ea9d69bd-6b8e-470b-9ac7-349be991841d tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053144 Sep 06 22:50:13.424327 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 444/878] 10.222.0.39 () {60 vars in 1343 bytes} [Tue Sep 6 22:50:13 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:50:13.490513 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-53cd2523-99cf-4060-b12c-54aadb07f4e2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:50:13.491039 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-53cd2523-99cf-4060-b12c-54aadb07f4e2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:50:13.493196 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:13.493848 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=3 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:13.499734 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-53cd2523-99cf-4060-b12c-54aadb07f4e2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:13.500204 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-53cd2523-99cf-4060-b12c-54aadb07f4e2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:13.500630 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-53cd2523-99cf-4060-b12c-54aadb07f4e2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:13.501330 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-53cd2523-99cf-4060-b12c-54aadb07f4e2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:13.501769 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-53cd2523-99cf-4060-b12c-54aadb07f4e2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:13.502196 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-53cd2523-99cf-4060-b12c-54aadb07f4e2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:13.529532 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-53cd2523-99cf-4060-b12c-54aadb07f4e2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Going to try to terminate instance {{(pid=127088) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 22:50:13.610518 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-53cd2523-99cf-4060-b12c-54aadb07f4e2 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 204 len: 0 microversion: 2.20 time: 0.123731 Sep 06 22:50:13.611427 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 435/879] 10.222.0.39 () {60 vars in 1280 bytes} [Tue Sep 6 22:50:13 2022] DELETE /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 22:50:13.619856 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ee17c72b-2727-43db-9e11-9e5b2d923763 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:50:13.620454 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ee17c72b-2727-43db-9e11-9e5b2d923763 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:50:13.626337 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ee17c72b-2727-43db-9e11-9e5b2d923763 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:13.626749 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ee17c72b-2727-43db-9e11-9e5b2d923763 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:13.627177 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ee17c72b-2727-43db-9e11-9e5b2d923763 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:13.628738 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ee17c72b-2727-43db-9e11-9e5b2d923763 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:13.628929 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ee17c72b-2727-43db-9e11-9e5b2d923763 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:13.629344 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ee17c72b-2727-43db-9e11-9e5b2d923763 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:13.761897 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ee17c72b-2727-43db-9e11-9e5b2d923763 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:50:13.771659 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ee17c72b-2727-43db-9e11-9e5b2d923763 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:50:13.773195 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ee17c72b-2727-43db-9e11-9e5b2d923763 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:50:13.774345 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ee17c72b-2727-43db-9e11-9e5b2d923763 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1724 microversion: 2.20 time: 0.158435 Sep 06 22:50:13.774898 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 445/880] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:50:13 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:50:14.801398 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9ee889c7-b151-4ff0-8b5b-c9359a5ea230 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:50:14.802087 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9ee889c7-b151-4ff0-8b5b-c9359a5ea230 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:50:14.808399 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ee889c7-b151-4ff0-8b5b-c9359a5ea230 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:14.808910 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ee889c7-b151-4ff0-8b5b-c9359a5ea230 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:14.809339 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ee889c7-b151-4ff0-8b5b-c9359a5ea230 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:14.810011 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ee889c7-b151-4ff0-8b5b-c9359a5ea230 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:14.810452 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ee889c7-b151-4ff0-8b5b-c9359a5ea230 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:14.810865 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9ee889c7-b151-4ff0-8b5b-c9359a5ea230 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:14.936219 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9ee889c7-b151-4ff0-8b5b-c9359a5ea230 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:50:14.944611 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9ee889c7-b151-4ff0-8b5b-c9359a5ea230 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:50:14.946115 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9ee889c7-b151-4ff0-8b5b-c9359a5ea230 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:50:14.947274 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9ee889c7-b151-4ff0-8b5b-c9359a5ea230 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1724 microversion: 2.20 time: 0.150075 Sep 06 22:50:14.947829 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 436/881] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:50:14 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:50:15.973804 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-133eac4d-a255-415e-9fca-c6868ae46a93 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:50:15.974402 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-133eac4d-a255-415e-9fca-c6868ae46a93 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:50:15.981510 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-133eac4d-a255-415e-9fca-c6868ae46a93 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:15.982139 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-133eac4d-a255-415e-9fca-c6868ae46a93 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:15.982667 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-133eac4d-a255-415e-9fca-c6868ae46a93 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:15.983469 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-133eac4d-a255-415e-9fca-c6868ae46a93 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:15.984034 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-133eac4d-a255-415e-9fca-c6868ae46a93 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:15.984585 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-133eac4d-a255-415e-9fca-c6868ae46a93 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:16.057842 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-133eac4d-a255-415e-9fca-c6868ae46a93 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:50:16.067475 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-133eac4d-a255-415e-9fca-c6868ae46a93 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:50:16.069195 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-133eac4d-a255-415e-9fca-c6868ae46a93 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e305e7d0cbfc4aeca6164685d0155475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bf7d2d331a472c9d517f3c3067f58e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:50:16.070355 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-133eac4d-a255-415e-9fca-c6868ae46a93 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 200 len: 1656 microversion: 2.20 time: 0.101111 Sep 06 22:50:16.071112 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 446/882] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:50:15 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 1656 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 22:50:16.229887 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-b9382b55-bc58-44c2-b252-49f5276fd13f req-7096c218-dbf7-4aba-ba78-d983a536d3bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c781a9d5-f194-47b8-870d-eab1adcc1ad5", "name": "network-vif-deleted", "tag": "e9150456-138e-49eb-8d2d-f86cecea4bae"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:50:16.240154 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-b9382b55-bc58-44c2-b252-49f5276fd13f req-7096c218-dbf7-4aba-ba78-d983a536d3bd service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:16.240640 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-b9382b55-bc58-44c2-b252-49f5276fd13f req-7096c218-dbf7-4aba-ba78-d983a536d3bd service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:16.241147 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-b9382b55-bc58-44c2-b252-49f5276fd13f req-7096c218-dbf7-4aba-ba78-d983a536d3bd service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:16.252496 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-b9382b55-bc58-44c2-b252-49f5276fd13f req-7096c218-dbf7-4aba-ba78-d983a536d3bd service nova] Creating event network-vif-deleted:e9150456-138e-49eb-8d2d-f86cecea4bae for instance c781a9d5-f194-47b8-870d-eab1adcc1ad5 on hv-cinder-85220 Sep 06 22:50:16.257290 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-b9382b55-bc58-44c2-b252-49f5276fd13f req-7096c218-dbf7-4aba-ba78-d983a536d3bd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031003 Sep 06 22:50:16.257983 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 437/883] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:50:17.095609 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9c92049e-f9f7-446f-890d-ae483d7a3033 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:50:17.096217 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9c92049e-f9f7-446f-890d-ae483d7a3033 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:50:17.102823 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9c92049e-f9f7-446f-890d-ae483d7a3033 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:17.103303 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9c92049e-f9f7-446f-890d-ae483d7a3033 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:17.103731 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9c92049e-f9f7-446f-890d-ae483d7a3033 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:17.104420 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9c92049e-f9f7-446f-890d-ae483d7a3033 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:17.104897 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9c92049e-f9f7-446f-890d-ae483d7a3033 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:17.105315 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9c92049e-f9f7-446f-890d-ae483d7a3033 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:17.119075 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-9c92049e-f9f7-446f-890d-ae483d7a3033 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] HTTP exception thrown: Instance c781a9d5-f194-47b8-870d-eab1adcc1ad5 could not be found. Sep 06 22:50:17.120881 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9c92049e-f9f7-446f-890d-ae483d7a3033 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Request method failure captured: Sep 06 22:50:17.120881 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: request: GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 HTTP/1.1 Sep 06 22:50:17.120881 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept: application/json Sep 06 22:50:17.120881 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Sep 06 22:50:17.120881 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Connection: close Sep 06 22:50:17.120881 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Length: 0 Sep 06 22:50:17.120881 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Type: application/json Sep 06 22:50:17.120881 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Host: 10.222.0.39 Sep 06 22:50:17.120881 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Sep 06 22:50:17.120881 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.12 Sep 06 22:50:17.120881 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABjF8zxwkObdcihdnMhfWv34KEq2z7aSE5SpstG059ijv5K4rQE_9vulC_t_gkfYKiZO44rYtsO3GnMW5bVaedMWSSsblZu5IiDZGkWjmE8ib-1xzFx9XFQOkldzg32LgfG0WnR1hA6nHPzXmywGbJMpXG1I7XbiAyjfzzKJJIpMYoRLHc Sep 06 22:50:17.120881 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Sep 06 22:50:17.120881 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Sep 06 22:50:17.120881 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Sep 06 22:50:17.120881 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Sep 06 22:50:17.120881 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 22:50:17.120881 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Sep 06 22:50:17.120881 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Sep 06 22:50:17.120881 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Id: 38bf7d2d331a472c9d517f3c3067f58e Sep 06 22:50:17.120881 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-702816689 Sep 06 22:50:17.120881 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Role: reader,member Sep 06 22:50:17.120881 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Sep 06 22:50:17.122604 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38bf7d2d331a472c9d517f3c3067f58e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38bf7d2d331a472c9d517f3c3067f58e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38bf7d2d331a472c9d517f3c3067f58e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38bf7d2d331a472c9d517f3c3067f58e"}]}] Sep 06 22:50:17.122604 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-AttachVolumeShelveTestJSON-702816689 Sep 06 22:50:17.122604 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 38bf7d2d331a472c9d517f3c3067f58e Sep 06 22:50:17.122604 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-702816689 Sep 06 22:50:17.122604 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User: tempest-AttachVolumeShelveTestJSON-702816689-project Sep 06 22:50:17.122604 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Sep 06 22:50:17.122604 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Sep 06 22:50:17.122604 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Id: e305e7d0cbfc4aeca6164685d0155475 Sep 06 22:50:17.122604 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-AttachVolumeShelveTestJSON-702816689-project Sep 06 22:50:17.122604 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: method: > Sep 06 22:50:17.122604 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: exception: Instance c781a9d5-f194-47b8-870d-eab1adcc1ad5 could not be found. Sep 06 22:50:17.122604 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: action_args: {'id': 'c781a9d5-f194-47b8-870d-eab1adcc1ad5'} Sep 06 22:50:17.123608 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:50:17.123608 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:50:17.123608 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:50:17.123608 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:50:17.123608 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:50:17.123608 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:50:17.123608 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:50:17.123608 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:50:17.123608 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:50:17.123608 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:50:17.123608 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c781a9d5-f194-47b8-870d-eab1adcc1ad5 could not be found. Sep 06 22:50:17.123608 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:50:17.123608 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:50:17.123608 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:50:17.123608 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:50:17.123608 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:50:17.123608 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:50:17.123608 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:50:17.123608 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:50:17.123608 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:50:17.126367 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:50:17.126367 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 22:50:17.126367 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 22:50:17.126367 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:50:17.126367 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:50:17.126367 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:50:17.126367 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:50:17.126367 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c781a9d5-f194-47b8-870d-eab1adcc1ad5 could not be found. Sep 06 22:50:17.126367 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:50:17.126367 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:50:17.126367 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:50:17.126367 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:50:17.126367 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:50:17.126367 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:50:17.126367 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:50:17.126367 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:50:17.126367 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c781a9d5-f194-47b8-870d-eab1adcc1ad5 could not be found. Sep 06 22:50:17.126367 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:50:17.130114 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9c92049e-f9f7-446f-890d-ae483d7a3033 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Returning 404 to user: Instance c781a9d5-f194-47b8-870d-eab1adcc1ad5 could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:50:17.130114 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9c92049e-f9f7-446f-890d-ae483d7a3033 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 404 len: 111 microversion: 2.20 time: 0.030548 Sep 06 22:50:17.130114 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 447/884] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:50:17 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 22:50:17.132955 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-83c01774-bfaf-4fba-b313-5e5b8238c788 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '.version_select at 0x7f9c4f61d3a0>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:50:17.151886 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-83c01774-bfaf-4fba-b313-5e5b8238c788 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1243742494" status: 204 len: 0 microversion: 2.20 time: 0.024314 Sep 06 22:50:17.152459 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 438/885] 10.222.0.39 () {60 vars in 1262 bytes} [Tue Sep 6 22:50:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1243742494 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 22:50:18.899333 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a7ac3abf-44bf-4285-bf09-13483c55d347 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:50:18.899820 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-a7ac3abf-44bf-4285-bf09-13483c55d347 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:50:18.906472 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a7ac3abf-44bf-4285-bf09-13483c55d347 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:18.906942 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a7ac3abf-44bf-4285-bf09-13483c55d347 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:18.907369 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a7ac3abf-44bf-4285-bf09-13483c55d347 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:18.908048 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a7ac3abf-44bf-4285-bf09-13483c55d347 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:18.908520 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a7ac3abf-44bf-4285-bf09-13483c55d347 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:18.909978 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a7ac3abf-44bf-4285-bf09-13483c55d347 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:18.922987 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-a7ac3abf-44bf-4285-bf09-13483c55d347 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] HTTP exception thrown: Instance c781a9d5-f194-47b8-870d-eab1adcc1ad5 could not be found. Sep 06 22:50:18.925129 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a7ac3abf-44bf-4285-bf09-13483c55d347 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Request method failure captured: Sep 06 22:50:18.925129 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: request: DELETE /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 HTTP/1.1 Sep 06 22:50:18.925129 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept: application/json Sep 06 22:50:18.925129 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Sep 06 22:50:18.925129 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Connection: close Sep 06 22:50:18.925129 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Length: 0 Sep 06 22:50:18.925129 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Type: application/json Sep 06 22:50:18.925129 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Host: 10.222.0.39 Sep 06 22:50:18.925129 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Sep 06 22:50:18.925129 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.12 Sep 06 22:50:18.925129 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABjF8zxwkObdcihdnMhfWv34KEq2z7aSE5SpstG059ijv5K4rQE_9vulC_t_gkfYKiZO44rYtsO3GnMW5bVaedMWSSsblZu5IiDZGkWjmE8ib-1xzFx9XFQOkldzg32LgfG0WnR1hA6nHPzXmywGbJMpXG1I7XbiAyjfzzKJJIpMYoRLHc Sep 06 22:50:18.925129 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Sep 06 22:50:18.925129 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Sep 06 22:50:18.925129 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Sep 06 22:50:18.925129 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Sep 06 22:50:18.925129 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 22:50:18.925129 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Sep 06 22:50:18.925129 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Sep 06 22:50:18.925129 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Id: 38bf7d2d331a472c9d517f3c3067f58e Sep 06 22:50:18.925129 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-702816689 Sep 06 22:50:18.925129 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Role: reader,member Sep 06 22:50:18.925129 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Sep 06 22:50:18.926756 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38bf7d2d331a472c9d517f3c3067f58e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38bf7d2d331a472c9d517f3c3067f58e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38bf7d2d331a472c9d517f3c3067f58e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38bf7d2d331a472c9d517f3c3067f58e"}]}] Sep 06 22:50:18.926756 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-AttachVolumeShelveTestJSON-702816689 Sep 06 22:50:18.926756 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 38bf7d2d331a472c9d517f3c3067f58e Sep 06 22:50:18.926756 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-702816689 Sep 06 22:50:18.926756 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User: tempest-AttachVolumeShelveTestJSON-702816689-project Sep 06 22:50:18.926756 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Sep 06 22:50:18.926756 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Sep 06 22:50:18.926756 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Id: e305e7d0cbfc4aeca6164685d0155475 Sep 06 22:50:18.926756 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-AttachVolumeShelveTestJSON-702816689-project Sep 06 22:50:18.926756 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: method: > Sep 06 22:50:18.926756 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: exception: Instance c781a9d5-f194-47b8-870d-eab1adcc1ad5 could not be found. Sep 06 22:50:18.926756 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: action_args: {'id': 'c781a9d5-f194-47b8-870d-eab1adcc1ad5'} Sep 06 22:50:18.927824 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:50:18.927824 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:50:18.927824 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:50:18.927824 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:50:18.927824 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:50:18.927824 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:50:18.927824 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:50:18.927824 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:50:18.927824 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:50:18.927824 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:50:18.927824 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c781a9d5-f194-47b8-870d-eab1adcc1ad5 could not be found. Sep 06 22:50:18.927824 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:50:18.927824 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:50:18.927824 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:50:18.927824 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:50:18.927824 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:50:18.927824 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:50:18.927824 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:50:18.927824 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:50:18.927824 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:50:18.929362 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:50:18.929362 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 22:50:18.929362 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 22:50:18.929362 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 22:50:18.929362 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 22:50:18.929362 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:50:18.929362 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:50:18.929362 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:50:18.929362 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:50:18.929362 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c781a9d5-f194-47b8-870d-eab1adcc1ad5 could not be found. Sep 06 22:50:18.929362 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:50:18.929362 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:50:18.929362 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:50:18.929362 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:50:18.929362 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:50:18.929362 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:50:18.929362 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:50:18.929362 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:50:18.929362 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c781a9d5-f194-47b8-870d-eab1adcc1ad5 could not be found. Sep 06 22:50:18.929362 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:50:18.931150 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a7ac3abf-44bf-4285-bf09-13483c55d347 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Returning 404 to user: Instance c781a9d5-f194-47b8-870d-eab1adcc1ad5 could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:50:18.931150 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-a7ac3abf-44bf-4285-bf09-13483c55d347 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 404 len: 111 microversion: 2.20 time: 0.031020 Sep 06 22:50:18.931150 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 448/886] 10.222.0.39 () {60 vars in 1280 bytes} [Tue Sep 6 22:50:18 2022] DELETE /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 22:50:18.935119 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-61fad465-34d9-4f61-90d8-3d06b19305e1 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:50:18.935851 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-61fad465-34d9-4f61-90d8-3d06b19305e1 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: c781a9d5-f194-47b8-870d-eab1adcc1ad5] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:50:18.943296 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-61fad465-34d9-4f61-90d8-3d06b19305e1 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:18.943779 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-61fad465-34d9-4f61-90d8-3d06b19305e1 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:18.944213 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-61fad465-34d9-4f61-90d8-3d06b19305e1 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:18.945059 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-61fad465-34d9-4f61-90d8-3d06b19305e1 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:18.945548 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-61fad465-34d9-4f61-90d8-3d06b19305e1 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:18.945996 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-61fad465-34d9-4f61-90d8-3d06b19305e1 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:18.960156 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-61fad465-34d9-4f61-90d8-3d06b19305e1 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] HTTP exception thrown: Instance c781a9d5-f194-47b8-870d-eab1adcc1ad5 could not be found. Sep 06 22:50:18.961787 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-61fad465-34d9-4f61-90d8-3d06b19305e1 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Request method failure captured: Sep 06 22:50:18.961787 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 HTTP/1.1 Sep 06 22:50:18.961787 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept: application/json Sep 06 22:50:18.961787 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Sep 06 22:50:18.961787 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Connection: close Sep 06 22:50:18.961787 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Length: 0 Sep 06 22:50:18.961787 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Type: application/json Sep 06 22:50:18.961787 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Host: 10.222.0.39 Sep 06 22:50:18.961787 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Sep 06 22:50:18.961787 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Sep 06 22:50:18.961787 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjF8zxwkObdcihdnMhfWv34KEq2z7aSE5SpstG059ijv5K4rQE_9vulC_t_gkfYKiZO44rYtsO3GnMW5bVaedMWSSsblZu5IiDZGkWjmE8ib-1xzFx9XFQOkldzg32LgfG0WnR1hA6nHPzXmywGbJMpXG1I7XbiAyjfzzKJJIpMYoRLHc Sep 06 22:50:18.961787 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Sep 06 22:50:18.961787 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Sep 06 22:50:18.961787 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Sep 06 22:50:18.961787 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Sep 06 22:50:18.961787 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 22:50:18.961787 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Sep 06 22:50:18.961787 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Sep 06 22:50:18.961787 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Id: 38bf7d2d331a472c9d517f3c3067f58e Sep 06 22:50:18.961787 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-702816689 Sep 06 22:50:18.961787 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Role: reader,member Sep 06 22:50:18.961787 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Sep 06 22:50:18.963488 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38bf7d2d331a472c9d517f3c3067f58e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38bf7d2d331a472c9d517f3c3067f58e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38bf7d2d331a472c9d517f3c3067f58e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38bf7d2d331a472c9d517f3c3067f58e"}]}] Sep 06 22:50:18.963488 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeShelveTestJSON-702816689 Sep 06 22:50:18.963488 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 38bf7d2d331a472c9d517f3c3067f58e Sep 06 22:50:18.963488 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-702816689 Sep 06 22:50:18.963488 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeShelveTestJSON-702816689-project Sep 06 22:50:18.963488 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Sep 06 22:50:18.963488 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Sep 06 22:50:18.963488 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Id: e305e7d0cbfc4aeca6164685d0155475 Sep 06 22:50:18.963488 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeShelveTestJSON-702816689-project Sep 06 22:50:18.963488 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: method: > Sep 06 22:50:18.963488 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: exception: Instance c781a9d5-f194-47b8-870d-eab1adcc1ad5 could not be found. Sep 06 22:50:18.963488 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: action_args: {'id': 'c781a9d5-f194-47b8-870d-eab1adcc1ad5'} Sep 06 22:50:18.964352 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:50:18.964352 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:50:18.964352 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:50:18.964352 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:50:18.964352 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:50:18.964352 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:50:18.964352 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:50:18.964352 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:50:18.964352 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:50:18.964352 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:50:18.964352 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c781a9d5-f194-47b8-870d-eab1adcc1ad5 could not be found. Sep 06 22:50:18.964352 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:50:18.964352 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:50:18.964352 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:50:18.964352 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:50:18.964352 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:50:18.964352 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:50:18.964352 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:50:18.964352 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:50:18.964352 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:50:18.965887 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:50:18.965887 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 22:50:18.965887 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 22:50:18.965887 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:50:18.965887 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:50:18.965887 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:50:18.965887 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:50:18.965887 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c781a9d5-f194-47b8-870d-eab1adcc1ad5 could not be found. Sep 06 22:50:18.965887 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:50:18.965887 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:50:18.965887 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:50:18.965887 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:50:18.965887 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:50:18.965887 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:50:18.965887 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:50:18.965887 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:50:18.965887 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c781a9d5-f194-47b8-870d-eab1adcc1ad5 could not be found. Sep 06 22:50:18.965887 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:50:18.967204 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-61fad465-34d9-4f61-90d8-3d06b19305e1 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Returning 404 to user: Instance c781a9d5-f194-47b8-870d-eab1adcc1ad5 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:50:18.967204 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-61fad465-34d9-4f61-90d8-3d06b19305e1 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5" status: 404 len: 111 microversion: 2.20 time: 0.032092 Sep 06 22:50:18.967204 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 439/887] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:50:18 2022] GET /compute/v2.1/servers/c781a9d5-f194-47b8-870d-eab1adcc1ad5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 22:50:20.102143 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ab7f936e-a623-4b2d-83be-f15fbbe73562 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:50:20.102633 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ab7f936e-a623-4b2d-83be-f15fbbe73562 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:50:20.108952 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ab7f936e-a623-4b2d-83be-f15fbbe73562 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:20.109426 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ab7f936e-a623-4b2d-83be-f15fbbe73562 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:20.109850 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ab7f936e-a623-4b2d-83be-f15fbbe73562 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:20.110529 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ab7f936e-a623-4b2d-83be-f15fbbe73562 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:20.110965 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ab7f936e-a623-4b2d-83be-f15fbbe73562 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:20.111372 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ab7f936e-a623-4b2d-83be-f15fbbe73562 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:20.126191 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-ab7f936e-a623-4b2d-83be-f15fbbe73562 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] HTTP exception thrown: Instance 13ef5db2-b5d1-41af-8c93-2851abb0b6dd could not be found. Sep 06 22:50:20.127703 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ab7f936e-a623-4b2d-83be-f15fbbe73562 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Request method failure captured: Sep 06 22:50:20.127703 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: request: DELETE /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd HTTP/1.1 Sep 06 22:50:20.127703 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept: application/json Sep 06 22:50:20.127703 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Sep 06 22:50:20.127703 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Connection: close Sep 06 22:50:20.127703 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Length: 0 Sep 06 22:50:20.127703 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Type: application/json Sep 06 22:50:20.127703 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Host: 10.222.0.39 Sep 06 22:50:20.127703 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Sep 06 22:50:20.127703 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.12 Sep 06 22:50:20.127703 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABjF8zxwkObdcihdnMhfWv34KEq2z7aSE5SpstG059ijv5K4rQE_9vulC_t_gkfYKiZO44rYtsO3GnMW5bVaedMWSSsblZu5IiDZGkWjmE8ib-1xzFx9XFQOkldzg32LgfG0WnR1hA6nHPzXmywGbJMpXG1I7XbiAyjfzzKJJIpMYoRLHc Sep 06 22:50:20.127703 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Sep 06 22:50:20.127703 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Sep 06 22:50:20.127703 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Sep 06 22:50:20.127703 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Sep 06 22:50:20.127703 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 22:50:20.127703 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Sep 06 22:50:20.127703 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Sep 06 22:50:20.127703 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Id: 38bf7d2d331a472c9d517f3c3067f58e Sep 06 22:50:20.127703 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-702816689 Sep 06 22:50:20.127703 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Role: reader,member Sep 06 22:50:20.127703 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Sep 06 22:50:20.129395 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38bf7d2d331a472c9d517f3c3067f58e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38bf7d2d331a472c9d517f3c3067f58e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38bf7d2d331a472c9d517f3c3067f58e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38bf7d2d331a472c9d517f3c3067f58e"}]}] Sep 06 22:50:20.129395 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-AttachVolumeShelveTestJSON-702816689 Sep 06 22:50:20.129395 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 38bf7d2d331a472c9d517f3c3067f58e Sep 06 22:50:20.129395 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-702816689 Sep 06 22:50:20.129395 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User: tempest-AttachVolumeShelveTestJSON-702816689-project Sep 06 22:50:20.129395 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Sep 06 22:50:20.129395 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Sep 06 22:50:20.129395 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Id: e305e7d0cbfc4aeca6164685d0155475 Sep 06 22:50:20.129395 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-AttachVolumeShelveTestJSON-702816689-project Sep 06 22:50:20.129395 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: method: > Sep 06 22:50:20.129395 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: exception: Instance 13ef5db2-b5d1-41af-8c93-2851abb0b6dd could not be found. Sep 06 22:50:20.129395 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: action_args: {'id': '13ef5db2-b5d1-41af-8c93-2851abb0b6dd'} Sep 06 22:50:20.130408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:50:20.130408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:50:20.130408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:50:20.130408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:50:20.130408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:50:20.130408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:50:20.130408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:50:20.130408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:50:20.130408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:50:20.130408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:50:20.130408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13ef5db2-b5d1-41af-8c93-2851abb0b6dd could not be found. Sep 06 22:50:20.130408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:50:20.130408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:50:20.130408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:50:20.130408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:50:20.130408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:50:20.130408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:50:20.130408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:50:20.130408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:50:20.130408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:50:20.131852 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:50:20.131852 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 22:50:20.131852 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 22:50:20.131852 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 22:50:20.131852 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 22:50:20.131852 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:50:20.131852 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:50:20.131852 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:50:20.131852 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:50:20.131852 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13ef5db2-b5d1-41af-8c93-2851abb0b6dd could not be found. Sep 06 22:50:20.131852 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:50:20.131852 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:50:20.131852 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:50:20.131852 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:50:20.131852 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:50:20.131852 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:50:20.131852 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:50:20.131852 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:50:20.131852 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13ef5db2-b5d1-41af-8c93-2851abb0b6dd could not be found. Sep 06 22:50:20.131852 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:50:20.133504 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ab7f936e-a623-4b2d-83be-f15fbbe73562 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Returning 404 to user: Instance 13ef5db2-b5d1-41af-8c93-2851abb0b6dd could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:50:20.133504 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ab7f936e-a623-4b2d-83be-f15fbbe73562 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "DELETE /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 404 len: 111 microversion: 2.20 time: 0.031477 Sep 06 22:50:20.133504 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 449/888] 10.222.0.39 () {60 vars in 1280 bytes} [Tue Sep 6 22:50:20 2022] DELETE /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 22:50:20.137437 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-90ec8082-a8da-4c01-ae49-aba61d3b94e7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:50:20.138036 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-90ec8082-a8da-4c01-ae49-aba61d3b94e7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] [instance: 13ef5db2-b5d1-41af-8c93-2851abb0b6dd] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:50:20.144866 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-90ec8082-a8da-4c01-ae49-aba61d3b94e7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:20.145483 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-90ec8082-a8da-4c01-ae49-aba61d3b94e7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:20.145910 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-90ec8082-a8da-4c01-ae49-aba61d3b94e7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:20.146587 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-90ec8082-a8da-4c01-ae49-aba61d3b94e7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:20.147034 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-90ec8082-a8da-4c01-ae49-aba61d3b94e7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:20.147472 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-90ec8082-a8da-4c01-ae49-aba61d3b94e7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:20.161343 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-90ec8082-a8da-4c01-ae49-aba61d3b94e7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] HTTP exception thrown: Instance 13ef5db2-b5d1-41af-8c93-2851abb0b6dd could not be found. Sep 06 22:50:20.162829 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-90ec8082-a8da-4c01-ae49-aba61d3b94e7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Request method failure captured: Sep 06 22:50:20.162829 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd HTTP/1.1 Sep 06 22:50:20.162829 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept: application/json Sep 06 22:50:20.162829 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Sep 06 22:50:20.162829 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Connection: close Sep 06 22:50:20.162829 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Length: 0 Sep 06 22:50:20.162829 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Type: application/json Sep 06 22:50:20.162829 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Host: 10.222.0.39 Sep 06 22:50:20.162829 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Sep 06 22:50:20.162829 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Sep 06 22:50:20.162829 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjF8zxwkObdcihdnMhfWv34KEq2z7aSE5SpstG059ijv5K4rQE_9vulC_t_gkfYKiZO44rYtsO3GnMW5bVaedMWSSsblZu5IiDZGkWjmE8ib-1xzFx9XFQOkldzg32LgfG0WnR1hA6nHPzXmywGbJMpXG1I7XbiAyjfzzKJJIpMYoRLHc Sep 06 22:50:20.162829 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Sep 06 22:50:20.162829 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Sep 06 22:50:20.162829 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Sep 06 22:50:20.162829 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Sep 06 22:50:20.162829 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 22:50:20.162829 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Sep 06 22:50:20.162829 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Sep 06 22:50:20.162829 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Id: 38bf7d2d331a472c9d517f3c3067f58e Sep 06 22:50:20.162829 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-702816689 Sep 06 22:50:20.162829 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Role: reader,member Sep 06 22:50:20.162829 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Sep 06 22:50:20.164506 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/38bf7d2d331a472c9d517f3c3067f58e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_38bf7d2d331a472c9d517f3c3067f58e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38bf7d2d331a472c9d517f3c3067f58e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/38bf7d2d331a472c9d517f3c3067f58e"}]}] Sep 06 22:50:20.164506 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeShelveTestJSON-702816689 Sep 06 22:50:20.164506 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 38bf7d2d331a472c9d517f3c3067f58e Sep 06 22:50:20.164506 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-702816689 Sep 06 22:50:20.164506 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeShelveTestJSON-702816689-project Sep 06 22:50:20.164506 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Sep 06 22:50:20.164506 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Sep 06 22:50:20.164506 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Id: e305e7d0cbfc4aeca6164685d0155475 Sep 06 22:50:20.164506 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeShelveTestJSON-702816689-project Sep 06 22:50:20.164506 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: method: > Sep 06 22:50:20.164506 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: exception: Instance 13ef5db2-b5d1-41af-8c93-2851abb0b6dd could not be found. Sep 06 22:50:20.164506 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: action_args: {'id': '13ef5db2-b5d1-41af-8c93-2851abb0b6dd'} Sep 06 22:50:20.165622 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:50:20.165622 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:50:20.165622 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:50:20.165622 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:50:20.165622 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:50:20.165622 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:50:20.165622 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:50:20.165622 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:50:20.165622 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:50:20.165622 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:50:20.165622 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13ef5db2-b5d1-41af-8c93-2851abb0b6dd could not be found. Sep 06 22:50:20.165622 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:50:20.165622 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:50:20.165622 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:50:20.165622 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:50:20.165622 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:50:20.165622 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:50:20.165622 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:50:20.165622 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:50:20.165622 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:50:20.167065 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:50:20.167065 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 22:50:20.167065 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 22:50:20.167065 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:50:20.167065 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:50:20.167065 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:50:20.167065 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:50:20.167065 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13ef5db2-b5d1-41af-8c93-2851abb0b6dd could not be found. Sep 06 22:50:20.167065 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:50:20.167065 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:50:20.167065 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:50:20.167065 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:50:20.167065 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:50:20.167065 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:50:20.167065 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:50:20.167065 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:50:20.167065 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13ef5db2-b5d1-41af-8c93-2851abb0b6dd could not be found. Sep 06 22:50:20.167065 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:50:20.168487 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-90ec8082-a8da-4c01-ae49-aba61d3b94e7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] Returning 404 to user: Instance 13ef5db2-b5d1-41af-8c93-2851abb0b6dd could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:50:20.168487 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-90ec8082-a8da-4c01-ae49-aba61d3b94e7 tempest-AttachVolumeShelveTestJSON-702816689 tempest-AttachVolumeShelveTestJSON-702816689-project] 10.222.0.39 "GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd" status: 404 len: 111 microversion: 2.20 time: 0.030514 Sep 06 22:50:20.168487 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 440/889] 10.222.0.39 () {60 vars in 1277 bytes} [Tue Sep 6 22:50:20 2022] GET /compute/v2.1/servers/13ef5db2-b5d1-41af-8c93-2851abb0b6dd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 22:50:28.549763 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a9871126-4f90-45c0-9f9e-8a0aedb77301 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Action: 'create', calling method: .version_select at 0x7f9c52ec4ca0>, body: {"keypair": {"name": "tempest-keypair-1816169644", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4MKI7Ovfpa1rMeqXAQYjG6ltxTIUgKWPJXdoherLx0GLvSzX+OSedkOqfp4fAEM4KvPEssRSDairMTsLkPA75aI2iuYz/NpR714b+QgLJGlUbAv+i87ffDIszpU/Ts+g=="}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:50:28.567362 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-a9871126-4f90-45c0-9f9e-8a0aedb77301 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Getting quotas for project 121c13a143f447a1822f8df04b1a31a5. Resources: {'key_pairs'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 22:50:28.571441 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-a9871126-4f90-45c0-9f9e-8a0aedb77301 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Getting quotas for user 68515ffe51b74aacb09e8584346e6db3 and project 121c13a143f447a1822f8df04b1a31a5. Resources: {'key_pairs'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 22:50:28.598531 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-a9871126-4f90-45c0-9f9e-8a0aedb77301 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.170830 Sep 06 22:50:28.599151 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 450/890] 10.222.0.39 () {60 vars in 1159 bytes} [Tue Sep 6 22:50:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:50:30.188569 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f4e75de2-f487-4c87-8722-3dcfe65e713b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-135623762", "imageRef": "93326d5e-4826-431e-9ad1-6ee2d44e48d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "11fd96bf-4fdb-44de-a3da-a6c9f281ae59"}], "security_groups": [{"name": "tempest-securitygroup--333115084"}], "key_name": "tempest-keypair-1816169644", "user_data": "}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:50:30.197579 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:30.198240 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:30.299123 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.network.neutron [None req-f4e75de2-f487-4c87-8722-3dcfe65e713b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] validate_networks() for [('11fd96bf-4fdb-44de-a3da-a6c9f281ae59', None, None, None, None, None)] {{(pid=127088) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 22:50:30.680681 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-f4e75de2-f487-4c87-8722-3dcfe65e713b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Flavor limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 22:50:30.681144 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-f4e75de2-f487-4c87-8722-3dcfe65e713b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Image limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 22:50:30.681604 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-f4e75de2-f487-4c87-8722-3dcfe65e713b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Flavor pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 22:50:30.682000 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-f4e75de2-f487-4c87-8722-3dcfe65e713b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Image pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 22:50:30.682398 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-f4e75de2-f487-4c87-8722-3dcfe65e713b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 22:50:30.692447 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4e75de2-f487-4c87-8722-3dcfe65e713b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:30.692972 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4e75de2-f487-4c87-8722-3dcfe65e713b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:30.693407 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4e75de2-f487-4c87-8722-3dcfe65e713b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:30.694134 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4e75de2-f487-4c87-8722-3dcfe65e713b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:30.694636 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4e75de2-f487-4c87-8722-3dcfe65e713b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:30.695084 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4e75de2-f487-4c87-8722-3dcfe65e713b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:30.712528 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-f4e75de2-f487-4c87-8722-3dcfe65e713b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Getting quotas for project 121c13a143f447a1822f8df04b1a31a5. Resources: {'instances', 'ram', 'cores'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 22:50:30.719324 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-f4e75de2-f487-4c87-8722-3dcfe65e713b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Getting quotas for user 68515ffe51b74aacb09e8584346e6db3 and project 121c13a143f447a1822f8df04b1a31a5. Resources: {'instances', 'ram', 'cores'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 22:50:30.736635 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f4e75de2-f487-4c87-8722-3dcfe65e713b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Going to run 1 instances... {{(pid=127088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 22:50:30.739966 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f4e75de2-f487-4c87-8722-3dcfe65e713b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: a55ba753-4ee6-4731-b85e-ea1bc484bc97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='93326d5e-4826-431e-9ad1-6ee2d44e48d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 22:50:30.791220 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f4e75de2-f487-4c87-8722-3dcfe65e713b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.606765 Sep 06 22:50:30.797642 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 441/891] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Sep 6 22:50:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 22:50:30.802995 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f5d51196-2373-4894-8272-77093df59de2 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:50:30.803603 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-f5d51196-2373-4894-8272-77093df59de2 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: a55ba753-4ee6-4731-b85e-ea1bc484bc97] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:50:30.806148 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=24 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:30.885613 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-f5d51196-2373-4894-8272-77093df59de2 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:50:30.894063 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-f5d51196-2373-4894-8272-77093df59de2 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97" status: 200 len: 1241 microversion: 2.1 time: 0.094824 Sep 06 22:50:30.894640 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 451/892] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:50:30 2022] GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97 => generated 1241 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:50:31.917054 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4fae74f0-efff-41c6-bae4-5d75295a3ef4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:50:31.918282 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4fae74f0-efff-41c6-bae4-5d75295a3ef4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: a55ba753-4ee6-4731-b85e-ea1bc484bc97] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:50:31.926868 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4fae74f0-efff-41c6-bae4-5d75295a3ef4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:31.927546 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4fae74f0-efff-41c6-bae4-5d75295a3ef4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:31.928140 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4fae74f0-efff-41c6-bae4-5d75295a3ef4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:31.928884 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4fae74f0-efff-41c6-bae4-5d75295a3ef4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:31.929336 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4fae74f0-efff-41c6-bae4-5d75295a3ef4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:31.929755 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4fae74f0-efff-41c6-bae4-5d75295a3ef4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:32.006192 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4fae74f0-efff-41c6-bae4-5d75295a3ef4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:50:32.015705 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4fae74f0-efff-41c6-bae4-5d75295a3ef4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97" status: 200 len: 1301 microversion: 2.1 time: 0.102854 Sep 06 22:50:32.031944 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 442/893] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:50:31 2022] GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97 => generated 1301 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:50:33.040174 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-3ce559c9-1b29-4886-bc4e-2bfaf0f7faec tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:50:33.040736 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-3ce559c9-1b29-4886-bc4e-2bfaf0f7faec tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: a55ba753-4ee6-4731-b85e-ea1bc484bc97] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:50:33.047143 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3ce559c9-1b29-4886-bc4e-2bfaf0f7faec tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:33.047620 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3ce559c9-1b29-4886-bc4e-2bfaf0f7faec tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:33.048046 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3ce559c9-1b29-4886-bc4e-2bfaf0f7faec tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:33.048750 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3ce559c9-1b29-4886-bc4e-2bfaf0f7faec tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:33.049214 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3ce559c9-1b29-4886-bc4e-2bfaf0f7faec tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:33.049651 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3ce559c9-1b29-4886-bc4e-2bfaf0f7faec tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:33.545479 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3ce559c9-1b29-4886-bc4e-2bfaf0f7faec tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:50:33.554233 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-3ce559c9-1b29-4886-bc4e-2bfaf0f7faec tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97" status: 200 len: 1366 microversion: 2.1 time: 0.517922 Sep 06 22:50:33.574155 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 452/894] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:50:33 2022] GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97 => generated 1366 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:50:33.786558 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-625efe61-93cc-4f7c-95c2-108f80aa5886 req-c60d2fd5-3d40-4b1c-b015-57789507d5a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a55ba753-4ee6-4731-b85e-ea1bc484bc97", "tag": "cad81a42-7a18-4bf8-bd81-ef1a4f8de70e"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:50:33.796565 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-625efe61-93cc-4f7c-95c2-108f80aa5886 req-c60d2fd5-3d40-4b1c-b015-57789507d5a8 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:33.797083 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-625efe61-93cc-4f7c-95c2-108f80aa5886 req-c60d2fd5-3d40-4b1c-b015-57789507d5a8 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:33.797507 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-625efe61-93cc-4f7c-95c2-108f80aa5886 req-c60d2fd5-3d40-4b1c-b015-57789507d5a8 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:33.808913 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-625efe61-93cc-4f7c-95c2-108f80aa5886 req-c60d2fd5-3d40-4b1c-b015-57789507d5a8 service nova] Creating event network-changed:cad81a42-7a18-4bf8-bd81-ef1a4f8de70e for instance a55ba753-4ee6-4731-b85e-ea1bc484bc97 on hv-cinder-85220 Sep 06 22:50:33.814025 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-625efe61-93cc-4f7c-95c2-108f80aa5886 req-c60d2fd5-3d40-4b1c-b015-57789507d5a8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031995 Sep 06 22:50:33.814623 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 443/895] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 22:50:34.582223 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-89fd6673-5970-4df9-aa84-43c97bec494d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:50:34.582834 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-89fd6673-5970-4df9-aa84-43c97bec494d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: a55ba753-4ee6-4731-b85e-ea1bc484bc97] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:50:34.589269 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-89fd6673-5970-4df9-aa84-43c97bec494d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:34.589745 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-89fd6673-5970-4df9-aa84-43c97bec494d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:34.590172 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-89fd6673-5970-4df9-aa84-43c97bec494d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:34.590849 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-89fd6673-5970-4df9-aa84-43c97bec494d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:34.591295 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-89fd6673-5970-4df9-aa84-43c97bec494d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:34.591706 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-89fd6673-5970-4df9-aa84-43c97bec494d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:34.720309 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-89fd6673-5970-4df9-aa84-43c97bec494d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:50:34.729501 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-89fd6673-5970-4df9-aa84-43c97bec494d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97" status: 200 len: 1366 microversion: 2.1 time: 0.151635 Sep 06 22:50:34.730072 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 453/896] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:50:34 2022] GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:50:35.754908 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c46cd855-2a36-4153-9fa6-c50c03595523 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:50:35.755608 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c46cd855-2a36-4153-9fa6-c50c03595523 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: a55ba753-4ee6-4731-b85e-ea1bc484bc97] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:50:35.761755 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c46cd855-2a36-4153-9fa6-c50c03595523 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:35.762236 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c46cd855-2a36-4153-9fa6-c50c03595523 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:35.762673 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c46cd855-2a36-4153-9fa6-c50c03595523 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:35.763378 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c46cd855-2a36-4153-9fa6-c50c03595523 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:35.763820 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c46cd855-2a36-4153-9fa6-c50c03595523 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:35.764243 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c46cd855-2a36-4153-9fa6-c50c03595523 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:35.905664 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c46cd855-2a36-4153-9fa6-c50c03595523 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:50:35.913423 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c46cd855-2a36-4153-9fa6-c50c03595523 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97" status: 200 len: 1366 microversion: 2.1 time: 0.163737 Sep 06 22:50:35.914046 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 444/897] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:50:35 2022] GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:50:36.937326 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9a44d8ef-1e88-40f8-a8dc-948eee5fc6d2 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:50:36.937916 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9a44d8ef-1e88-40f8-a8dc-948eee5fc6d2 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: a55ba753-4ee6-4731-b85e-ea1bc484bc97] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:50:36.945528 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9a44d8ef-1e88-40f8-a8dc-948eee5fc6d2 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:36.946134 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9a44d8ef-1e88-40f8-a8dc-948eee5fc6d2 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:36.946572 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9a44d8ef-1e88-40f8-a8dc-948eee5fc6d2 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:36.947267 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9a44d8ef-1e88-40f8-a8dc-948eee5fc6d2 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:36.947848 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9a44d8ef-1e88-40f8-a8dc-948eee5fc6d2 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:36.948273 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9a44d8ef-1e88-40f8-a8dc-948eee5fc6d2 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:37.100623 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-9a44d8ef-1e88-40f8-a8dc-948eee5fc6d2 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:50:37.109257 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9a44d8ef-1e88-40f8-a8dc-948eee5fc6d2 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97" status: 200 len: 1366 microversion: 2.1 time: 0.175665 Sep 06 22:50:37.120784 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 454/898] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:50:36 2022] GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:50:38.134035 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-511e42c3-2069-4807-a0c6-038730a18e8a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:50:38.134648 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-511e42c3-2069-4807-a0c6-038730a18e8a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: a55ba753-4ee6-4731-b85e-ea1bc484bc97] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:50:38.141102 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-511e42c3-2069-4807-a0c6-038730a18e8a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:38.141581 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-511e42c3-2069-4807-a0c6-038730a18e8a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:38.142015 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-511e42c3-2069-4807-a0c6-038730a18e8a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:38.142701 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-511e42c3-2069-4807-a0c6-038730a18e8a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:38.143153 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-511e42c3-2069-4807-a0c6-038730a18e8a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:38.143575 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-511e42c3-2069-4807-a0c6-038730a18e8a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:38.283063 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-511e42c3-2069-4807-a0c6-038730a18e8a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:50:38.291332 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-511e42c3-2069-4807-a0c6-038730a18e8a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97" status: 200 len: 1366 microversion: 2.1 time: 0.161172 Sep 06 22:50:38.291892 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 445/899] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:50:38 2022] GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:50:39.131382 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-e88e768d-fbcf-4c2a-92bf-84dc61f350c2 req-27a43b7c-71a7-4e3a-8650-2f3e4978a35a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a55ba753-4ee6-4731-b85e-ea1bc484bc97", "name": "network-vif-plugged", "status": "completed", "tag": "cad81a42-7a18-4bf8-bd81-ef1a4f8de70e"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:50:39.141559 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-e88e768d-fbcf-4c2a-92bf-84dc61f350c2 req-27a43b7c-71a7-4e3a-8650-2f3e4978a35a service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:39.142041 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-e88e768d-fbcf-4c2a-92bf-84dc61f350c2 req-27a43b7c-71a7-4e3a-8650-2f3e4978a35a service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:39.142468 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-e88e768d-fbcf-4c2a-92bf-84dc61f350c2 req-27a43b7c-71a7-4e3a-8650-2f3e4978a35a service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:39.155899 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-e88e768d-fbcf-4c2a-92bf-84dc61f350c2 req-27a43b7c-71a7-4e3a-8650-2f3e4978a35a service nova] Creating event network-vif-plugged:cad81a42-7a18-4bf8-bd81-ef1a4f8de70e for instance a55ba753-4ee6-4731-b85e-ea1bc484bc97 on hv-cinder-85220 Sep 06 22:50:39.161223 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-e88e768d-fbcf-4c2a-92bf-84dc61f350c2 req-27a43b7c-71a7-4e3a-8650-2f3e4978a35a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034103 Sep 06 22:50:39.161819 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 455/900] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:50:39.314710 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-ff1f77c9-1795-47c2-a641-95071ab03b0b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:50:39.315320 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-ff1f77c9-1795-47c2-a641-95071ab03b0b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: a55ba753-4ee6-4731-b85e-ea1bc484bc97] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:50:39.322497 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ff1f77c9-1795-47c2-a641-95071ab03b0b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:39.322977 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ff1f77c9-1795-47c2-a641-95071ab03b0b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:39.323413 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ff1f77c9-1795-47c2-a641-95071ab03b0b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:39.324100 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ff1f77c9-1795-47c2-a641-95071ab03b0b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:39.324578 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ff1f77c9-1795-47c2-a641-95071ab03b0b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:39.325028 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-ff1f77c9-1795-47c2-a641-95071ab03b0b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:39.469798 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-ff1f77c9-1795-47c2-a641-95071ab03b0b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:50:39.477405 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-ff1f77c9-1795-47c2-a641-95071ab03b0b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97" status: 200 len: 1366 microversion: 2.1 time: 0.166570 Sep 06 22:50:39.477967 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 446/901] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:50:39 2022] GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:50:40.500848 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-dbad5572-d7ce-4164-9b50-a67ca4e46ae4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:50:40.501553 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-dbad5572-d7ce-4164-9b50-a67ca4e46ae4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: a55ba753-4ee6-4731-b85e-ea1bc484bc97] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:50:40.508360 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dbad5572-d7ce-4164-9b50-a67ca4e46ae4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:40.508866 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dbad5572-d7ce-4164-9b50-a67ca4e46ae4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:40.509296 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dbad5572-d7ce-4164-9b50-a67ca4e46ae4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:40.509980 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dbad5572-d7ce-4164-9b50-a67ca4e46ae4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:40.510428 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dbad5572-d7ce-4164-9b50-a67ca4e46ae4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:40.510846 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-dbad5572-d7ce-4164-9b50-a67ca4e46ae4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:40.640088 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-dbad5572-d7ce-4164-9b50-a67ca4e46ae4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:50:40.648168 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-dbad5572-d7ce-4164-9b50-a67ca4e46ae4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97" status: 200 len: 1366 microversion: 2.1 time: 0.151630 Sep 06 22:50:40.648723 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 456/902] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:50:40 2022] GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:50:41.671341 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0dd99aef-f8d7-4535-89ab-3a2ea1f4ec4b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:50:41.671948 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0dd99aef-f8d7-4535-89ab-3a2ea1f4ec4b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: a55ba753-4ee6-4731-b85e-ea1bc484bc97] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:50:41.674381 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:41.675131 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=6 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:41.681110 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0dd99aef-f8d7-4535-89ab-3a2ea1f4ec4b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:41.681593 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0dd99aef-f8d7-4535-89ab-3a2ea1f4ec4b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:41.682027 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0dd99aef-f8d7-4535-89ab-3a2ea1f4ec4b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:41.682712 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0dd99aef-f8d7-4535-89ab-3a2ea1f4ec4b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:41.683158 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0dd99aef-f8d7-4535-89ab-3a2ea1f4ec4b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:41.683577 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0dd99aef-f8d7-4535-89ab-3a2ea1f4ec4b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:41.815816 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0dd99aef-f8d7-4535-89ab-3a2ea1f4ec4b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:50:41.823501 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0dd99aef-f8d7-4535-89ab-3a2ea1f4ec4b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97" status: 200 len: 1556 microversion: 2.1 time: 0.156032 Sep 06 22:50:41.824054 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 447/903] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:50:41 2022] GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97 => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:50:41.846370 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-4f7d4370-aa01-4876-887f-febe261da736 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:50:41.848019 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-4f7d4370-aa01-4876-887f-febe261da736 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: a55ba753-4ee6-4731-b85e-ea1bc484bc97] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:50:41.849592 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=6 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:41.855215 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4f7d4370-aa01-4876-887f-febe261da736 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:41.855716 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4f7d4370-aa01-4876-887f-febe261da736 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:41.856144 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4f7d4370-aa01-4876-887f-febe261da736 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:41.856850 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4f7d4370-aa01-4876-887f-febe261da736 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:41.857291 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4f7d4370-aa01-4876-887f-febe261da736 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:41.857698 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4f7d4370-aa01-4876-887f-febe261da736 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:41.937001 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-4f7d4370-aa01-4876-887f-febe261da736 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094406 Sep 06 22:50:41.937596 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 457/904] 10.222.0.39 () {58 vars in 1275 bytes} [Tue Sep 6 22:50:41 2022] GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:50:42.850012 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-4c5f05ee-5241-4681-92aa-ea7670315aac req-d6abf1d5-cc5e-48cd-8ff6-585d4499c209 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a55ba753-4ee6-4731-b85e-ea1bc484bc97", "tag": "cad81a42-7a18-4bf8-bd81-ef1a4f8de70e"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:50:42.860064 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-4c5f05ee-5241-4681-92aa-ea7670315aac req-d6abf1d5-cc5e-48cd-8ff6-585d4499c209 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:42.860543 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-4c5f05ee-5241-4681-92aa-ea7670315aac req-d6abf1d5-cc5e-48cd-8ff6-585d4499c209 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:42.861112 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-4c5f05ee-5241-4681-92aa-ea7670315aac req-d6abf1d5-cc5e-48cd-8ff6-585d4499c209 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:42.874272 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-4c5f05ee-5241-4681-92aa-ea7670315aac req-d6abf1d5-cc5e-48cd-8ff6-585d4499c209 service nova] Creating event network-changed:cad81a42-7a18-4bf8-bd81-ef1a4f8de70e for instance a55ba753-4ee6-4731-b85e-ea1bc484bc97 on hv-cinder-85220 Sep 06 22:50:42.880228 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-4c5f05ee-5241-4681-92aa-ea7670315aac req-d6abf1d5-cc5e-48cd-8ff6-585d4499c209 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034027 Sep 06 22:50:42.882740 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 448/905] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:50:51.593697 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-7c7e7f6f-266b-487c-8dc1-c373f32bcc06 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:50:51.594730 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-7c7e7f6f-266b-487c-8dc1-c373f32bcc06 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:50:51.594934 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-15957db7-93a5-49c9-9113-ddf451f20ccf req-ffd5062c-a18b-492c-8ed3-500801c0cd22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43a8e21a-339a-4ea5-ad07-4d74e92be9de", "tag": "1501f706-7e9c-4f45-b83a-b0e52d8d1f26"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:50:51.597042 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:50:51.602992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7c7e7f6f-266b-487c-8dc1-c373f32bcc06 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:51.603556 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7c7e7f6f-266b-487c-8dc1-c373f32bcc06 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:51.604197 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7c7e7f6f-266b-487c-8dc1-c373f32bcc06 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:51.605425 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7c7e7f6f-266b-487c-8dc1-c373f32bcc06 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:51.605556 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-15957db7-93a5-49c9-9113-ddf451f20ccf req-ffd5062c-a18b-492c-8ed3-500801c0cd22 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:51.606063 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-15957db7-93a5-49c9-9113-ddf451f20ccf req-ffd5062c-a18b-492c-8ed3-500801c0cd22 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:51.606472 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7c7e7f6f-266b-487c-8dc1-c373f32bcc06 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:51.606601 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-15957db7-93a5-49c9-9113-ddf451f20ccf req-ffd5062c-a18b-492c-8ed3-500801c0cd22 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:51.607210 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-7c7e7f6f-266b-487c-8dc1-c373f32bcc06 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:51.618417 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-15957db7-93a5-49c9-9113-ddf451f20ccf req-ffd5062c-a18b-492c-8ed3-500801c0cd22 service nova] Creating event network-changed:1501f706-7e9c-4f45-b83a-b0e52d8d1f26 for instance 43a8e21a-339a-4ea5-ad07-4d74e92be9de on hv-cinder-85220 Sep 06 22:50:51.623545 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-15957db7-93a5-49c9-9113-ddf451f20ccf req-ffd5062c-a18b-492c-8ed3-500801c0cd22 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033075 Sep 06 22:50:51.624347 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 449/906] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 22:50:51.638259 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-7c7e7f6f-266b-487c-8dc1-c373f32bcc06 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Going to try to terminate instance {{(pid=127087) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 22:50:51.744143 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-7c7e7f6f-266b-487c-8dc1-c373f32bcc06 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "DELETE /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 204 len: 0 microversion: 2.1 time: 0.155884 Sep 06 22:50:51.745037 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 458/907] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Sep 6 22:50:51 2022] DELETE /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 22:50:51.755453 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-c677cdd5-7cbb-4563-be15-df59b19965da tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:50:51.756159 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-c677cdd5-7cbb-4563-be15-df59b19965da tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:50:51.763978 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c677cdd5-7cbb-4563-be15-df59b19965da tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:51.764885 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c677cdd5-7cbb-4563-be15-df59b19965da tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:51.765301 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c677cdd5-7cbb-4563-be15-df59b19965da tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:51.765995 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c677cdd5-7cbb-4563-be15-df59b19965da tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:51.766435 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c677cdd5-7cbb-4563-be15-df59b19965da tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:51.767050 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-c677cdd5-7cbb-4563-be15-df59b19965da tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:51.915651 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-c677cdd5-7cbb-4563-be15-df59b19965da tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:50:51.923418 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-c677cdd5-7cbb-4563-be15-df59b19965da tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1569 microversion: 2.1 time: 0.173798 Sep 06 22:50:51.923980 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 450/908] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:50:51 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:50:52.947652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-8ee12e91-a22d-4042-9d2d-daf4d9c09b31 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:50:52.948339 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-8ee12e91-a22d-4042-9d2d-daf4d9c09b31 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:50:52.954336 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8ee12e91-a22d-4042-9d2d-daf4d9c09b31 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:52.954813 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8ee12e91-a22d-4042-9d2d-daf4d9c09b31 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:52.955243 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8ee12e91-a22d-4042-9d2d-daf4d9c09b31 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:52.955935 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8ee12e91-a22d-4042-9d2d-daf4d9c09b31 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:52.956363 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8ee12e91-a22d-4042-9d2d-daf4d9c09b31 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:52.957756 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8ee12e91-a22d-4042-9d2d-daf4d9c09b31 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:53.088835 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-8ee12e91-a22d-4042-9d2d-daf4d9c09b31 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:50:53.096296 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-8ee12e91-a22d-4042-9d2d-daf4d9c09b31 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1569 microversion: 2.1 time: 0.153038 Sep 06 22:50:53.096879 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 459/909] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:50:52 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:50:54.119919 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0cbb737d-c796-4dd6-811f-9a83ea406d22 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:50:54.120580 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0cbb737d-c796-4dd6-811f-9a83ea406d22 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:50:54.127286 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0cbb737d-c796-4dd6-811f-9a83ea406d22 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:54.127772 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0cbb737d-c796-4dd6-811f-9a83ea406d22 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:54.128197 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0cbb737d-c796-4dd6-811f-9a83ea406d22 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:54.129496 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0cbb737d-c796-4dd6-811f-9a83ea406d22 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:54.129976 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0cbb737d-c796-4dd6-811f-9a83ea406d22 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:54.130399 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0cbb737d-c796-4dd6-811f-9a83ea406d22 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:54.333793 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-59fb7bb0-e74a-41c6-b965-2391a8b9f2dd req-3f0c91bc-a80e-4d08-8396-e1ab6fa47ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43a8e21a-339a-4ea5-ad07-4d74e92be9de", "name": "network-vif-deleted", "tag": "1501f706-7e9c-4f45-b83a-b0e52d8d1f26"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:50:54.344564 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-59fb7bb0-e74a-41c6-b965-2391a8b9f2dd req-3f0c91bc-a80e-4d08-8396-e1ab6fa47ca5 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:54.345529 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-59fb7bb0-e74a-41c6-b965-2391a8b9f2dd req-3f0c91bc-a80e-4d08-8396-e1ab6fa47ca5 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:54.346012 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-59fb7bb0-e74a-41c6-b965-2391a8b9f2dd req-3f0c91bc-a80e-4d08-8396-e1ab6fa47ca5 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:54.349231 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0cbb737d-c796-4dd6-811f-9a83ea406d22 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcede7fa39dd47f7ba80c5add2c0f750', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410f8fc9cc284ba78edf9f4db25f9d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:50:54.357738 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0cbb737d-c796-4dd6-811f-9a83ea406d22 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 200 len: 1384 microversion: 2.1 time: 0.241691 Sep 06 22:50:54.358647 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 451/910] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:50:54 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 1384 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:50:54.369480 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-59fb7bb0-e74a-41c6-b965-2391a8b9f2dd req-3f0c91bc-a80e-4d08-8396-e1ab6fa47ca5 service nova] Creating event network-vif-deleted:1501f706-7e9c-4f45-b83a-b0e52d8d1f26 for instance 43a8e21a-339a-4ea5-ad07-4d74e92be9de on hv-cinder-85220 Sep 06 22:50:54.372096 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-59fb7bb0-e74a-41c6-b965-2391a8b9f2dd req-3f0c91bc-a80e-4d08-8396-e1ab6fa47ca5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041978 Sep 06 22:50:54.376453 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 460/911] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:50:55.387606 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8b88e02e-6f8d-40ea-ac0f-21c008d58565 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:50:55.388241 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8b88e02e-6f8d-40ea-ac0f-21c008d58565 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] [instance: 43a8e21a-339a-4ea5-ad07-4d74e92be9de] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:50:55.395255 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8b88e02e-6f8d-40ea-ac0f-21c008d58565 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:55.395742 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8b88e02e-6f8d-40ea-ac0f-21c008d58565 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:55.396179 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8b88e02e-6f8d-40ea-ac0f-21c008d58565 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:55.396916 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8b88e02e-6f8d-40ea-ac0f-21c008d58565 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:50:55.397374 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8b88e02e-6f8d-40ea-ac0f-21c008d58565 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:50:55.397886 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8b88e02e-6f8d-40ea-ac0f-21c008d58565 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:50:55.412141 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-8b88e02e-6f8d-40ea-ac0f-21c008d58565 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] HTTP exception thrown: Instance 43a8e21a-339a-4ea5-ad07-4d74e92be9de could not be found. Sep 06 22:50:55.413827 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8b88e02e-6f8d-40ea-ac0f-21c008d58565 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Request method failure captured: Sep 06 22:50:55.413827 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de HTTP/1.1 Sep 06 22:50:55.413827 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept: application/json Sep 06 22:50:55.413827 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Sep 06 22:50:55.413827 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Connection: close Sep 06 22:50:55.413827 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Length: 0 Sep 06 22:50:55.413827 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Type: application/json Sep 06 22:50:55.413827 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Host: 10.222.0.39 Sep 06 22:50:55.413827 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Sep 06 22:50:55.413827 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Sep 06 22:50:55.413827 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjF82YhGONv68JDL1MmSg-ozQdZ6lAYvvKIC2pfWCmMv3bXeLCSMWPf4JK21zvr5uPXIMbvvKcYqGdbmpslzI01X-kzDbUgHZSeIeHEXRrAesbAE_HvRaQfKXPqmwO4J5U3b82jOLvHDljnhoarHTLNxA6vHU8Mfq-5fAm99gNBta10rg Sep 06 22:50:55.413827 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Sep 06 22:50:55.413827 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Sep 06 22:50:55.413827 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Sep 06 22:50:55.413827 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Sep 06 22:50:55.413827 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Sep 06 22:50:55.413827 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Sep 06 22:50:55.413827 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Id: 410f8fc9cc284ba78edf9f4db25f9d31 Sep 06 22:50:55.413827 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-TestShelveInstance-694551775 Sep 06 22:50:55.413827 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Role: reader,member Sep 06 22:50:55.413827 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Sep 06 22:50:55.415534 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/410f8fc9cc284ba78edf9f4db25f9d31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_410f8fc9cc284ba78edf9f4db25f9d31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/410f8fc9cc284ba78edf9f4db25f9d31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/410f8fc9cc284ba78edf9f4db25f9d31"}]}] Sep 06 22:50:55.415534 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-TestShelveInstance-694551775 Sep 06 22:50:55.415534 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 410f8fc9cc284ba78edf9f4db25f9d31 Sep 06 22:50:55.415534 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-TestShelveInstance-694551775 Sep 06 22:50:55.415534 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User: tempest-TestShelveInstance-694551775-project Sep 06 22:50:55.415534 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Sep 06 22:50:55.415534 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Sep 06 22:50:55.415534 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Id: bcede7fa39dd47f7ba80c5add2c0f750 Sep 06 22:50:55.415534 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-TestShelveInstance-694551775-project Sep 06 22:50:55.415534 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: method: > Sep 06 22:50:55.415534 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: exception: Instance 43a8e21a-339a-4ea5-ad07-4d74e92be9de could not be found. Sep 06 22:50:55.415534 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: action_args: {'id': '43a8e21a-339a-4ea5-ad07-4d74e92be9de'} Sep 06 22:50:55.416570 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:50:55.416570 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:50:55.416570 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:50:55.416570 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:50:55.416570 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:50:55.416570 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:50:55.416570 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:50:55.416570 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:50:55.416570 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:50:55.416570 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:50:55.416570 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43a8e21a-339a-4ea5-ad07-4d74e92be9de could not be found. Sep 06 22:50:55.416570 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:50:55.416570 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:50:55.416570 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:50:55.416570 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:50:55.416570 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:50:55.416570 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:50:55.416570 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:50:55.416570 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:50:55.416570 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:50:55.418190 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:50:55.418190 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 22:50:55.418190 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 22:50:55.418190 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:50:55.418190 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:50:55.418190 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:50:55.418190 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:50:55.418190 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43a8e21a-339a-4ea5-ad07-4d74e92be9de could not be found. Sep 06 22:50:55.418190 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:50:55.418190 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:50:55.418190 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:50:55.418190 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:50:55.418190 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:50:55.418190 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:50:55.418190 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:50:55.418190 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:50:55.418190 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43a8e21a-339a-4ea5-ad07-4d74e92be9de could not be found. Sep 06 22:50:55.418190 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:50:55.420207 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8b88e02e-6f8d-40ea-ac0f-21c008d58565 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Returning 404 to user: Instance 43a8e21a-339a-4ea5-ad07-4d74e92be9de could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:50:55.421104 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8b88e02e-6f8d-40ea-ac0f-21c008d58565 tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de" status: 404 len: 111 microversion: 2.1 time: 0.037419 Sep 06 22:50:55.421646 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 452/912] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:50:55 2022] GET /compute/v2.1/servers/43a8e21a-339a-4ea5-ad07-4d74e92be9de => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 22:50:55.592332 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d0c2df97-6361-492e-9974-7bf76a45b7da tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] Calling method '.version_select at 0x7f9c52f72040>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:50:55.610563 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d0c2df97-6361-492e-9974-7bf76a45b7da tempest-TestShelveInstance-694551775 tempest-TestShelveInstance-694551775-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1356466728" status: 202 len: 0 microversion: 2.1 time: 0.022751 Sep 06 22:50:55.614418 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 461/913] 10.222.0.39 () {58 vars in 1254 bytes} [Tue Sep 6 22:50:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1356466728 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 22:51:14.412017 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8b641a7a-2c2e-4d6d-a7c0-30c450c03006 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-318037766", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1102918603", "security_groups": [{"name": "tempest-secgroup-smoke-1541823835"}], "block_device_mapping_v2": [{"uuid": "c32ca8e1-c1c6-4eb5-862d-ad45c38e7075", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "58d448a5-1081-4b4c-a11f-e7854551fb17"}]}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:51:14.422492 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:51:14.423123 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=52 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:51:14.525442 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.network.neutron [None req-8b641a7a-2c2e-4d6d-a7c0-30c450c03006 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] validate_networks() for [('58d448a5-1081-4b4c-a11f-e7854551fb17', None, None, None, None, None)] {{(pid=127088) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 22:51:14.890681 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-8b641a7a-2c2e-4d6d-a7c0-30c450c03006 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Flavor limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 22:51:14.891330 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-8b641a7a-2c2e-4d6d-a7c0-30c450c03006 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Image limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 22:51:14.891806 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-8b641a7a-2c2e-4d6d-a7c0-30c450c03006 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Flavor pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 22:51:14.892214 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-8b641a7a-2c2e-4d6d-a7c0-30c450c03006 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Image pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 22:51:14.892654 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-8b641a7a-2c2e-4d6d-a7c0-30c450c03006 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 22:51:14.901538 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8b641a7a-2c2e-4d6d-a7c0-30c450c03006 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:14.902016 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8b641a7a-2c2e-4d6d-a7c0-30c450c03006 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:14.902449 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8b641a7a-2c2e-4d6d-a7c0-30c450c03006 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:14.903171 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8b641a7a-2c2e-4d6d-a7c0-30c450c03006 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:14.903621 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8b641a7a-2c2e-4d6d-a7c0-30c450c03006 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:14.904042 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8b641a7a-2c2e-4d6d-a7c0-30c450c03006 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:14.920584 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-8b641a7a-2c2e-4d6d-a7c0-30c450c03006 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Getting quotas for project cc47231427ec4337833eb5d733b211bc. Resources: {'instances', 'ram', 'cores'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 22:51:14.924518 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-8b641a7a-2c2e-4d6d-a7c0-30c450c03006 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Getting quotas for user 29018ec15cc147d3919d9047569a4c68 and project cc47231427ec4337833eb5d733b211bc. Resources: {'instances', 'ram', 'cores'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 22:51:14.980578 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8b641a7a-2c2e-4d6d-a7c0-30c450c03006 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Going to run 1 instances... {{(pid=127088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 22:51:14.982718 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8b641a7a-2c2e-4d6d-a7c0-30c450c03006 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 3a478b90-1417-492e-88c5-171aa3fa7eee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c32ca8e1-c1c6-4eb5-862d-ad45c38e7075',volume_size=None,volume_type=None)] {{(pid=127088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 22:51:15.110189 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8b641a7a-2c2e-4d6d-a7c0-30c450c03006 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.704410 Sep 06 22:51:15.110825 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 453/914] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Sep 6 22:51:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 22:51:15.120039 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:51:15.120804 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:51:15.125139 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-67323940-510d-4ae0-acef-1dd57262bd49 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:51:15.125833 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-67323940-510d-4ae0-acef-1dd57262bd49 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 3a478b90-1417-492e-88c5-171aa3fa7eee] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:51:15.186170 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-67323940-510d-4ae0-acef-1dd57262bd49 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:51:15.193717 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-67323940-510d-4ae0-acef-1dd57262bd49 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/3a478b90-1417-492e-88c5-171aa3fa7eee" status: 200 len: 1094 microversion: 2.1 time: 0.075070 Sep 06 22:51:15.194285 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 462/915] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:51:15 2022] GET /compute/v2.1/servers/3a478b90-1417-492e-88c5-171aa3fa7eee => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:51:16.215653 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2844f311-e72d-4cb6-842d-4aa276305bcd tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:51:16.216538 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2844f311-e72d-4cb6-842d-4aa276305bcd tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 3a478b90-1417-492e-88c5-171aa3fa7eee] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:51:16.223281 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2844f311-e72d-4cb6-842d-4aa276305bcd tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:16.223894 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2844f311-e72d-4cb6-842d-4aa276305bcd tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:16.224397 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2844f311-e72d-4cb6-842d-4aa276305bcd tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:16.225227 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2844f311-e72d-4cb6-842d-4aa276305bcd tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:16.225744 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2844f311-e72d-4cb6-842d-4aa276305bcd tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:16.226233 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2844f311-e72d-4cb6-842d-4aa276305bcd tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:16.298626 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2844f311-e72d-4cb6-842d-4aa276305bcd tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:51:16.307031 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2844f311-e72d-4cb6-842d-4aa276305bcd tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/3a478b90-1417-492e-88c5-171aa3fa7eee" status: 200 len: 1210 microversion: 2.1 time: 0.095226 Sep 06 22:51:16.307753 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 454/916] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:51:16 2022] GET /compute/v2.1/servers/3a478b90-1417-492e-88c5-171aa3fa7eee => generated 1210 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:51:17.330688 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e205d292-2a68-4ab7-a66f-0230a5438d72 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:51:17.332190 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e205d292-2a68-4ab7-a66f-0230a5438d72 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 3a478b90-1417-492e-88c5-171aa3fa7eee] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:51:17.339387 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e205d292-2a68-4ab7-a66f-0230a5438d72 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:17.339886 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e205d292-2a68-4ab7-a66f-0230a5438d72 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:17.340309 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e205d292-2a68-4ab7-a66f-0230a5438d72 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:17.341229 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e205d292-2a68-4ab7-a66f-0230a5438d72 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:17.342009 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e205d292-2a68-4ab7-a66f-0230a5438d72 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:17.342716 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e205d292-2a68-4ab7-a66f-0230a5438d72 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:17.559844 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e205d292-2a68-4ab7-a66f-0230a5438d72 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:51:17.567721 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e205d292-2a68-4ab7-a66f-0230a5438d72 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/3a478b90-1417-492e-88c5-171aa3fa7eee" status: 200 len: 1266 microversion: 2.1 time: 0.240898 Sep 06 22:51:17.568289 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 463/917] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:51:17 2022] GET /compute/v2.1/servers/3a478b90-1417-492e-88c5-171aa3fa7eee => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:51:17.635579 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-51e35818-df21-4b24-a69c-4591903d6be3 req-458bd2a3-5309-4569-b727-6c4f36dc859a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a478b90-1417-492e-88c5-171aa3fa7eee", "tag": "7108485c-a4f8-4d78-afb6-a3a836cff2d7"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:51:17.647398 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-51e35818-df21-4b24-a69c-4591903d6be3 req-458bd2a3-5309-4569-b727-6c4f36dc859a service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:17.648163 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-51e35818-df21-4b24-a69c-4591903d6be3 req-458bd2a3-5309-4569-b727-6c4f36dc859a service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:17.648716 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-51e35818-df21-4b24-a69c-4591903d6be3 req-458bd2a3-5309-4569-b727-6c4f36dc859a service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:17.662014 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-51e35818-df21-4b24-a69c-4591903d6be3 req-458bd2a3-5309-4569-b727-6c4f36dc859a service nova] Creating event network-changed:7108485c-a4f8-4d78-afb6-a3a836cff2d7 for instance 3a478b90-1417-492e-88c5-171aa3fa7eee on hv-cinder-85220 Sep 06 22:51:17.666951 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-51e35818-df21-4b24-a69c-4591903d6be3 req-458bd2a3-5309-4569-b727-6c4f36dc859a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035394 Sep 06 22:51:17.667560 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 455/918] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:51:17.984032 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b6f585a4-bb3a-431e-8f32-8f99d7b2ce9c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:51:17.984514 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b6f585a4-bb3a-431e-8f32-8f99d7b2ce9c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: a55ba753-4ee6-4731-b85e-ea1bc484bc97] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:51:17.990531 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b6f585a4-bb3a-431e-8f32-8f99d7b2ce9c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:17.991005 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b6f585a4-bb3a-431e-8f32-8f99d7b2ce9c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:17.991433 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b6f585a4-bb3a-431e-8f32-8f99d7b2ce9c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:17.992114 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b6f585a4-bb3a-431e-8f32-8f99d7b2ce9c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:17.992553 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b6f585a4-bb3a-431e-8f32-8f99d7b2ce9c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:17.993005 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b6f585a4-bb3a-431e-8f32-8f99d7b2ce9c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:18.016136 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b6f585a4-bb3a-431e-8f32-8f99d7b2ce9c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97/ips" status: 200 len: 149 microversion: 2.1 time: 0.035871 Sep 06 22:51:18.016705 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 464/919] 10.222.0.39 () {58 vars in 1248 bytes} [Tue Sep 6 22:51:17 2022] GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:51:18.591445 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0c282f85-7577-430b-94c1-089c8ea38541 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:51:18.592139 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0c282f85-7577-430b-94c1-089c8ea38541 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 3a478b90-1417-492e-88c5-171aa3fa7eee] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:51:18.598916 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0c282f85-7577-430b-94c1-089c8ea38541 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:18.599394 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0c282f85-7577-430b-94c1-089c8ea38541 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:18.599824 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0c282f85-7577-430b-94c1-089c8ea38541 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:18.600500 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0c282f85-7577-430b-94c1-089c8ea38541 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:18.600973 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0c282f85-7577-430b-94c1-089c8ea38541 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:18.601388 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0c282f85-7577-430b-94c1-089c8ea38541 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:18.846441 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0c282f85-7577-430b-94c1-089c8ea38541 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:51:18.854887 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0c282f85-7577-430b-94c1-089c8ea38541 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/3a478b90-1417-492e-88c5-171aa3fa7eee" status: 200 len: 1266 microversion: 2.1 time: 0.267617 Sep 06 22:51:18.855466 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 456/920] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:51:18 2022] GET /compute/v2.1/servers/3a478b90-1417-492e-88c5-171aa3fa7eee => generated 1266 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:51:19.383324 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-355bb5f4-7259-4bf7-a4e4-696c389b2325 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88410187-ebcf-40fe-adf9-be927ecb57ae"}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:51:19.385734 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-355bb5f4-7259-4bf7-a4e4-696c389b2325 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: a55ba753-4ee6-4731-b85e-ea1bc484bc97] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:51:19.392086 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-355bb5f4-7259-4bf7-a4e4-696c389b2325 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:19.392565 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-355bb5f4-7259-4bf7-a4e4-696c389b2325 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:19.393031 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-355bb5f4-7259-4bf7-a4e4-696c389b2325 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:19.393717 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-355bb5f4-7259-4bf7-a4e4-696c389b2325 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:19.394280 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-355bb5f4-7259-4bf7-a4e4-696c389b2325 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:19.394860 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-355bb5f4-7259-4bf7-a4e4-696c389b2325 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:19.636135 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-355bb5f4-7259-4bf7-a4e4-696c389b2325 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "POST /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257200 Sep 06 22:51:19.636727 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 465/921] 10.222.0.39 () {60 vars in 1323 bytes} [Tue Sep 6 22:51:19 2022] POST /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:51:19.877457 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2af397f6-6ec5-4de8-b2aa-6f64ae7b89e3 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:51:19.878087 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2af397f6-6ec5-4de8-b2aa-6f64ae7b89e3 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 3a478b90-1417-492e-88c5-171aa3fa7eee] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:51:19.885096 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2af397f6-6ec5-4de8-b2aa-6f64ae7b89e3 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:19.885572 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2af397f6-6ec5-4de8-b2aa-6f64ae7b89e3 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:19.886002 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2af397f6-6ec5-4de8-b2aa-6f64ae7b89e3 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:19.886677 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2af397f6-6ec5-4de8-b2aa-6f64ae7b89e3 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:19.887120 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2af397f6-6ec5-4de8-b2aa-6f64ae7b89e3 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:19.887537 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2af397f6-6ec5-4de8-b2aa-6f64ae7b89e3 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:20.020610 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2af397f6-6ec5-4de8-b2aa-6f64ae7b89e3 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:51:20.028206 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2af397f6-6ec5-4de8-b2aa-6f64ae7b89e3 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/3a478b90-1417-492e-88c5-171aa3fa7eee" status: 200 len: 1266 microversion: 2.1 time: 0.154676 Sep 06 22:51:20.028777 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 457/922] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:51:19 2022] GET /compute/v2.1/servers/3a478b90-1417-492e-88c5-171aa3fa7eee => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:51:21.053176 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-8b2335e2-4d9b-4614-a590-ff5ea64450d2 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:51:21.053785 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-8b2335e2-4d9b-4614-a590-ff5ea64450d2 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 3a478b90-1417-492e-88c5-171aa3fa7eee] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:51:21.059922 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8b2335e2-4d9b-4614-a590-ff5ea64450d2 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:21.060398 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8b2335e2-4d9b-4614-a590-ff5ea64450d2 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:21.060844 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8b2335e2-4d9b-4614-a590-ff5ea64450d2 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:21.061525 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8b2335e2-4d9b-4614-a590-ff5ea64450d2 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:21.061974 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8b2335e2-4d9b-4614-a590-ff5ea64450d2 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:21.062389 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8b2335e2-4d9b-4614-a590-ff5ea64450d2 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:21.198426 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-8b2335e2-4d9b-4614-a590-ff5ea64450d2 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:51:21.206008 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-8b2335e2-4d9b-4614-a590-ff5ea64450d2 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/3a478b90-1417-492e-88c5-171aa3fa7eee" status: 200 len: 1266 microversion: 2.1 time: 0.157845 Sep 06 22:51:21.207244 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 466/923] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:51:21 2022] GET /compute/v2.1/servers/3a478b90-1417-492e-88c5-171aa3fa7eee => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:51:22.229535 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8a4dd9ca-ec7a-4f9a-a5a8-1f3a30bd77d8 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:51:22.230162 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8a4dd9ca-ec7a-4f9a-a5a8-1f3a30bd77d8 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 3a478b90-1417-492e-88c5-171aa3fa7eee] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:51:22.236662 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8a4dd9ca-ec7a-4f9a-a5a8-1f3a30bd77d8 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:22.237164 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8a4dd9ca-ec7a-4f9a-a5a8-1f3a30bd77d8 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:22.237590 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8a4dd9ca-ec7a-4f9a-a5a8-1f3a30bd77d8 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:22.238462 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8a4dd9ca-ec7a-4f9a-a5a8-1f3a30bd77d8 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:22.238907 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8a4dd9ca-ec7a-4f9a-a5a8-1f3a30bd77d8 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:22.239320 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8a4dd9ca-ec7a-4f9a-a5a8-1f3a30bd77d8 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:22.370255 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8a4dd9ca-ec7a-4f9a-a5a8-1f3a30bd77d8 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:51:22.377834 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8a4dd9ca-ec7a-4f9a-a5a8-1f3a30bd77d8 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/3a478b90-1417-492e-88c5-171aa3fa7eee" status: 200 len: 1266 microversion: 2.1 time: 0.152171 Sep 06 22:51:22.378991 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 458/924] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:51:22 2022] GET /compute/v2.1/servers/3a478b90-1417-492e-88c5-171aa3fa7eee => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:51:23.401511 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-8f4e049c-447f-435c-810c-1791d6fc0b52 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:51:23.402117 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-8f4e049c-447f-435c-810c-1791d6fc0b52 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 3a478b90-1417-492e-88c5-171aa3fa7eee] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:51:23.408786 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8f4e049c-447f-435c-810c-1791d6fc0b52 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:23.409265 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8f4e049c-447f-435c-810c-1791d6fc0b52 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:23.409743 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8f4e049c-447f-435c-810c-1791d6fc0b52 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:23.410419 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8f4e049c-447f-435c-810c-1791d6fc0b52 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:23.410861 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8f4e049c-447f-435c-810c-1791d6fc0b52 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:23.411275 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8f4e049c-447f-435c-810c-1791d6fc0b52 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:23.538201 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-8f4e049c-447f-435c-810c-1791d6fc0b52 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:51:23.545739 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-8f4e049c-447f-435c-810c-1791d6fc0b52 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/3a478b90-1417-492e-88c5-171aa3fa7eee" status: 200 len: 1266 microversion: 2.1 time: 0.148218 Sep 06 22:51:23.546292 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 467/925] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:51:23 2022] GET /compute/v2.1/servers/3a478b90-1417-492e-88c5-171aa3fa7eee => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:51:24.568904 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-642444c2-19e5-455d-a250-7f8519ac41dd tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:51:24.569438 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-642444c2-19e5-455d-a250-7f8519ac41dd tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 3a478b90-1417-492e-88c5-171aa3fa7eee] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:51:24.576035 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-642444c2-19e5-455d-a250-7f8519ac41dd tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:24.577073 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-642444c2-19e5-455d-a250-7f8519ac41dd tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:24.577637 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-642444c2-19e5-455d-a250-7f8519ac41dd tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:24.578878 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-642444c2-19e5-455d-a250-7f8519ac41dd tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:24.579707 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-642444c2-19e5-455d-a250-7f8519ac41dd tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:24.580490 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-642444c2-19e5-455d-a250-7f8519ac41dd tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:24.725024 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-642444c2-19e5-455d-a250-7f8519ac41dd tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:51:24.732738 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-642444c2-19e5-455d-a250-7f8519ac41dd tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/3a478b90-1417-492e-88c5-171aa3fa7eee" status: 200 len: 1266 microversion: 2.1 time: 0.167944 Sep 06 22:51:24.733321 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 459/926] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:51:24 2022] GET /compute/v2.1/servers/3a478b90-1417-492e-88c5-171aa3fa7eee => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:51:25.756250 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d414bdf1-df74-4de8-98a9-3ce70bd8cd94 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:51:25.756837 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-d414bdf1-df74-4de8-98a9-3ce70bd8cd94 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 3a478b90-1417-492e-88c5-171aa3fa7eee] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:51:25.759448 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=2 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:51:25.766270 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d414bdf1-df74-4de8-98a9-3ce70bd8cd94 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:25.766270 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d414bdf1-df74-4de8-98a9-3ce70bd8cd94 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:25.766825 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d414bdf1-df74-4de8-98a9-3ce70bd8cd94 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:25.767580 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d414bdf1-df74-4de8-98a9-3ce70bd8cd94 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:25.768091 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d414bdf1-df74-4de8-98a9-3ce70bd8cd94 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:25.768510 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d414bdf1-df74-4de8-98a9-3ce70bd8cd94 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:25.909413 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-d414bdf1-df74-4de8-98a9-3ce70bd8cd94 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:51:25.917749 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d414bdf1-df74-4de8-98a9-3ce70bd8cd94 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/3a478b90-1417-492e-88c5-171aa3fa7eee" status: 200 len: 1266 microversion: 2.1 time: 0.166138 Sep 06 22:51:25.918317 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 468/927] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:51:25 2022] GET /compute/v2.1/servers/3a478b90-1417-492e-88c5-171aa3fa7eee => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:51:26.130110 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-958bab21-51f3-4197-bc72-2cd0cf1b1e76 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Action: 'create', calling method: .version_select at 0x7f9c4f613dc0>, body: {"keypair": {"name": "tempest-keypair-887454961", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvb9Zu1CDkzYJnQXB+K5SJrWT4ANjsV9RGeStitqjGsRLrBHUO+a7go05uMc4QZjpYQae2dxvt77sPIQKQNn2veC/z1fstvtu1xEjZ2FBAJIxyKXlgXPPfWsoN/vyUyQQ=="}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:51:26.135312 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:51:26.135959 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=6 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:51:26.148573 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-958bab21-51f3-4197-bc72-2cd0cf1b1e76 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Getting quotas for project 121c13a143f447a1822f8df04b1a31a5. Resources: {'key_pairs'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 22:51:26.152322 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-958bab21-51f3-4197-bc72-2cd0cf1b1e76 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Getting quotas for user 68515ffe51b74aacb09e8584346e6db3 and project 121c13a143f447a1822f8df04b1a31a5. Resources: {'key_pairs'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 22:51:26.173960 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-958bab21-51f3-4197-bc72-2cd0cf1b1e76 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047794 Sep 06 22:51:26.174531 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 460/928] 10.222.0.39 () {60 vars in 1159 bytes} [Tue Sep 6 22:51:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:51:26.940492 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b41cd8c6-f2cf-44be-8540-0382a8ffd884 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:51:26.941325 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b41cd8c6-f2cf-44be-8540-0382a8ffd884 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 3a478b90-1417-492e-88c5-171aa3fa7eee] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:51:26.947986 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b41cd8c6-f2cf-44be-8540-0382a8ffd884 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:26.948468 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b41cd8c6-f2cf-44be-8540-0382a8ffd884 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:26.948932 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b41cd8c6-f2cf-44be-8540-0382a8ffd884 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:26.949614 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b41cd8c6-f2cf-44be-8540-0382a8ffd884 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:26.950055 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b41cd8c6-f2cf-44be-8540-0382a8ffd884 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:26.950470 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b41cd8c6-f2cf-44be-8540-0382a8ffd884 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:27.095749 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b41cd8c6-f2cf-44be-8540-0382a8ffd884 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:51:27.103993 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b41cd8c6-f2cf-44be-8540-0382a8ffd884 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/3a478b90-1417-492e-88c5-171aa3fa7eee" status: 200 len: 1266 microversion: 2.1 time: 0.167414 Sep 06 22:51:27.104556 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 469/929] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:51:26 2022] GET /compute/v2.1/servers/3a478b90-1417-492e-88c5-171aa3fa7eee => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:51:27.388284 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-feeefb32-773d-4813-8271-fb0b1c71f42d req-193014e4-88f1-4c55-a230-f011e181cfa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a478b90-1417-492e-88c5-171aa3fa7eee", "name": "network-vif-plugged", "status": "completed", "tag": "7108485c-a4f8-4d78-afb6-a3a836cff2d7"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:51:27.400335 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-feeefb32-773d-4813-8271-fb0b1c71f42d req-193014e4-88f1-4c55-a230-f011e181cfa1 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:27.400849 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-feeefb32-773d-4813-8271-fb0b1c71f42d req-193014e4-88f1-4c55-a230-f011e181cfa1 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:27.401330 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-feeefb32-773d-4813-8271-fb0b1c71f42d req-193014e4-88f1-4c55-a230-f011e181cfa1 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:27.412330 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-feeefb32-773d-4813-8271-fb0b1c71f42d req-193014e4-88f1-4c55-a230-f011e181cfa1 service nova] Creating event network-vif-plugged:7108485c-a4f8-4d78-afb6-a3a836cff2d7 for instance 3a478b90-1417-492e-88c5-171aa3fa7eee on hv-cinder-85220 Sep 06 22:51:27.418159 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-feeefb32-773d-4813-8271-fb0b1c71f42d req-193014e4-88f1-4c55-a230-f011e181cfa1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034362 Sep 06 22:51:27.418756 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 461/930] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:51:27.448295 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-9e5fadf9-8c89-4206-9602-4669671c8399 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1145759869", "imageRef": "93326d5e-4826-431e-9ad1-6ee2d44e48d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "11fd96bf-4fdb-44de-a3da-a6c9f281ae59"}], "security_groups": [{"name": "tempest-securitygroup--412255282"}], "key_name": "tempest-keypair-887454961", "user_data": "}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:51:27.557309 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.network.neutron [None req-9e5fadf9-8c89-4206-9602-4669671c8399 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] validate_networks() for [('11fd96bf-4fdb-44de-a3da-a6c9f281ae59', None, None, None, None, None)] {{(pid=127087) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 22:51:27.994603 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-9e5fadf9-8c89-4206-9602-4669671c8399 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Flavor limits 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 22:51:27.995178 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-9e5fadf9-8c89-4206-9602-4669671c8399 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Image limits 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 22:51:27.995462 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-9e5fadf9-8c89-4206-9602-4669671c8399 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Flavor pref 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 22:51:27.995855 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-9e5fadf9-8c89-4206-9602-4669671c8399 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Image pref 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 22:51:27.996251 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-9e5fadf9-8c89-4206-9602-4669671c8399 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 22:51:28.005246 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9e5fadf9-8c89-4206-9602-4669671c8399 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:28.005712 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9e5fadf9-8c89-4206-9602-4669671c8399 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:28.006130 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9e5fadf9-8c89-4206-9602-4669671c8399 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:28.006842 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9e5fadf9-8c89-4206-9602-4669671c8399 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:28.007278 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9e5fadf9-8c89-4206-9602-4669671c8399 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:28.007685 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-9e5fadf9-8c89-4206-9602-4669671c8399 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:28.024372 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-9e5fadf9-8c89-4206-9602-4669671c8399 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Getting quotas for project 121c13a143f447a1822f8df04b1a31a5. Resources: {'instances', 'ram', 'cores'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 22:51:28.028528 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-9e5fadf9-8c89-4206-9602-4669671c8399 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Getting quotas for user 68515ffe51b74aacb09e8584346e6db3 and project 121c13a143f447a1822f8df04b1a31a5. Resources: {'instances', 'ram', 'cores'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 22:51:28.041515 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9e5fadf9-8c89-4206-9602-4669671c8399 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Going to run 1 instances... {{(pid=127087) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 22:51:28.043791 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-9e5fadf9-8c89-4206-9602-4669671c8399 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='93326d5e-4826-431e-9ad1-6ee2d44e48d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 22:51:28.090840 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-9e5fadf9-8c89-4206-9602-4669671c8399 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.647156 Sep 06 22:51:28.091670 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 470/931] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Sep 6 22:51:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 22:51:28.103984 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-26adea88-c466-4e2f-8f68-4c56bf4c8fd0 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:51:28.104676 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-26adea88-c466-4e2f-8f68-4c56bf4c8fd0 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:51:28.126613 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e341d768-f731-49fb-8bcb-13ef0bbbfc7a tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:51:28.126800 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e341d768-f731-49fb-8bcb-13ef0bbbfc7a tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 3a478b90-1417-492e-88c5-171aa3fa7eee] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:51:28.133881 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e341d768-f731-49fb-8bcb-13ef0bbbfc7a tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:28.134358 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e341d768-f731-49fb-8bcb-13ef0bbbfc7a tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:28.134786 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e341d768-f731-49fb-8bcb-13ef0bbbfc7a tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:28.135467 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e341d768-f731-49fb-8bcb-13ef0bbbfc7a tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:28.135946 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e341d768-f731-49fb-8bcb-13ef0bbbfc7a tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:28.136362 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e341d768-f731-49fb-8bcb-13ef0bbbfc7a tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:28.176154 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-26adea88-c466-4e2f-8f68-4c56bf4c8fd0 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:51:28.183164 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-26adea88-c466-4e2f-8f68-4c56bf4c8fd0 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc" status: 200 len: 1241 microversion: 2.1 time: 0.083456 Sep 06 22:51:28.188448 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 462/932] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:51:28 2022] GET /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:51:28.280041 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e341d768-f731-49fb-8bcb-13ef0bbbfc7a tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:51:28.288021 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e341d768-f731-49fb-8bcb-13ef0bbbfc7a tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/3a478b90-1417-492e-88c5-171aa3fa7eee" status: 200 len: 1266 microversion: 2.1 time: 0.165693 Sep 06 22:51:28.288794 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 471/933] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:51:28 2022] GET /compute/v2.1/servers/3a478b90-1417-492e-88c5-171aa3fa7eee => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:51:29.205591 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-66a4ba46-74ce-42df-b4bf-b262b5bad0c4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:51:29.206202 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-66a4ba46-74ce-42df-b4bf-b262b5bad0c4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:51:29.213590 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-66a4ba46-74ce-42df-b4bf-b262b5bad0c4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:29.214075 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-66a4ba46-74ce-42df-b4bf-b262b5bad0c4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:29.214510 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-66a4ba46-74ce-42df-b4bf-b262b5bad0c4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:29.215202 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-66a4ba46-74ce-42df-b4bf-b262b5bad0c4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:29.215657 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-66a4ba46-74ce-42df-b4bf-b262b5bad0c4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:29.216086 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-66a4ba46-74ce-42df-b4bf-b262b5bad0c4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:29.281815 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-66a4ba46-74ce-42df-b4bf-b262b5bad0c4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:51:29.290010 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-66a4ba46-74ce-42df-b4bf-b262b5bad0c4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc" status: 200 len: 1293 microversion: 2.1 time: 0.088242 Sep 06 22:51:29.290565 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 463/934] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:51:29 2022] GET /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:51:29.311158 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-bfc34984-1153-4ef6-8c45-d5fdc7954366 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:51:29.311792 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-bfc34984-1153-4ef6-8c45-d5fdc7954366 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 3a478b90-1417-492e-88c5-171aa3fa7eee] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:51:29.318298 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bfc34984-1153-4ef6-8c45-d5fdc7954366 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:29.318763 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bfc34984-1153-4ef6-8c45-d5fdc7954366 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:29.319183 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bfc34984-1153-4ef6-8c45-d5fdc7954366 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:29.319858 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bfc34984-1153-4ef6-8c45-d5fdc7954366 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:29.320297 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bfc34984-1153-4ef6-8c45-d5fdc7954366 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:29.320706 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-bfc34984-1153-4ef6-8c45-d5fdc7954366 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:29.449232 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-bfc34984-1153-4ef6-8c45-d5fdc7954366 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:51:29.456801 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-bfc34984-1153-4ef6-8c45-d5fdc7954366 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/3a478b90-1417-492e-88c5-171aa3fa7eee" status: 200 len: 1454 microversion: 2.1 time: 0.149469 Sep 06 22:51:29.457362 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 472/935] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:51:29 2022] GET /compute/v2.1/servers/3a478b90-1417-492e-88c5-171aa3fa7eee => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:51:29.479610 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-267e52bf-ec13-4a0e-8bd9-c9c0d6c5b033 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:51:29.480306 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-267e52bf-ec13-4a0e-8bd9-c9c0d6c5b033 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 3a478b90-1417-492e-88c5-171aa3fa7eee] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:51:29.487028 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-267e52bf-ec13-4a0e-8bd9-c9c0d6c5b033 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:29.487517 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-267e52bf-ec13-4a0e-8bd9-c9c0d6c5b033 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:29.488903 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-267e52bf-ec13-4a0e-8bd9-c9c0d6c5b033 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:29.489607 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-267e52bf-ec13-4a0e-8bd9-c9c0d6c5b033 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:29.490069 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-267e52bf-ec13-4a0e-8bd9-c9c0d6c5b033 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:29.490499 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-267e52bf-ec13-4a0e-8bd9-c9c0d6c5b033 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:29.715161 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-267e52bf-ec13-4a0e-8bd9-c9c0d6c5b033 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:51:29.723672 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-267e52bf-ec13-4a0e-8bd9-c9c0d6c5b033 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/3a478b90-1417-492e-88c5-171aa3fa7eee" status: 200 len: 1454 microversion: 2.1 time: 0.248424 Sep 06 22:51:29.724233 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 464/936] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:51:29 2022] GET /compute/v2.1/servers/3a478b90-1417-492e-88c5-171aa3fa7eee => generated 1454 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:51:30.314978 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-0cc309cc-60f3-4710-b12c-18dfec1c6102 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:51:30.315611 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-0cc309cc-60f3-4710-b12c-18dfec1c6102 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:51:30.325334 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0cc309cc-60f3-4710-b12c-18dfec1c6102 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:30.326203 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0cc309cc-60f3-4710-b12c-18dfec1c6102 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:30.326806 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0cc309cc-60f3-4710-b12c-18dfec1c6102 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:30.327787 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0cc309cc-60f3-4710-b12c-18dfec1c6102 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:30.328232 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0cc309cc-60f3-4710-b12c-18dfec1c6102 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:30.328792 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0cc309cc-60f3-4710-b12c-18dfec1c6102 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:30.574550 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-0cc309cc-60f3-4710-b12c-18dfec1c6102 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:51:30.584270 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-0cc309cc-60f3-4710-b12c-18dfec1c6102 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc" status: 200 len: 1366 microversion: 2.1 time: 0.274671 Sep 06 22:51:30.600939 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 473/937] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:51:30 2022] GET /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc => generated 1366 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:51:31.419778 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-1cd8a24a-9923-4e9a-a36a-7f72b9715c90 req-ea846041-3f30-4405-9794-8931ba8fce9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60e1fda2-c9b3-48ff-a9f5-18ce551b70dc", "tag": "3021d148-87a0-4bfe-b540-8b533f38df53"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:51:31.440590 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-1cd8a24a-9923-4e9a-a36a-7f72b9715c90 req-ea846041-3f30-4405-9794-8931ba8fce9f service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:31.442129 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-1cd8a24a-9923-4e9a-a36a-7f72b9715c90 req-ea846041-3f30-4405-9794-8931ba8fce9f service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:31.442747 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-1cd8a24a-9923-4e9a-a36a-7f72b9715c90 req-ea846041-3f30-4405-9794-8931ba8fce9f service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:31.455961 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-1cd8a24a-9923-4e9a-a36a-7f72b9715c90 req-ea846041-3f30-4405-9794-8931ba8fce9f service nova] Creating event network-changed:3021d148-87a0-4bfe-b540-8b533f38df53 for instance 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc on hv-cinder-85220 Sep 06 22:51:31.462842 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-1cd8a24a-9923-4e9a-a36a-7f72b9715c90 req-ea846041-3f30-4405-9794-8931ba8fce9f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048304 Sep 06 22:51:31.464303 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 465/938] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:51:31.607612 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-06f6146f-2cba-4b56-82ef-fce5e63c4947 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:51:31.608212 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-06f6146f-2cba-4b56-82ef-fce5e63c4947 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:51:31.615468 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-06f6146f-2cba-4b56-82ef-fce5e63c4947 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:31.615945 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-06f6146f-2cba-4b56-82ef-fce5e63c4947 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:31.616370 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-06f6146f-2cba-4b56-82ef-fce5e63c4947 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:31.617154 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-06f6146f-2cba-4b56-82ef-fce5e63c4947 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:31.617588 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-06f6146f-2cba-4b56-82ef-fce5e63c4947 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:31.617995 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-06f6146f-2cba-4b56-82ef-fce5e63c4947 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:31.770307 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-8125a113-b188-4a87-a15d-1cc335d73fbd req-2504212f-be49-466d-bf07-6a99aeac947a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a478b90-1417-492e-88c5-171aa3fa7eee", "tag": "7108485c-a4f8-4d78-afb6-a3a836cff2d7"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:51:31.780493 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-8125a113-b188-4a87-a15d-1cc335d73fbd req-2504212f-be49-466d-bf07-6a99aeac947a service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:31.780992 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-8125a113-b188-4a87-a15d-1cc335d73fbd req-2504212f-be49-466d-bf07-6a99aeac947a service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:31.781424 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-8125a113-b188-4a87-a15d-1cc335d73fbd req-2504212f-be49-466d-bf07-6a99aeac947a service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:31.793194 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-8125a113-b188-4a87-a15d-1cc335d73fbd req-2504212f-be49-466d-bf07-6a99aeac947a service nova] Creating event network-changed:7108485c-a4f8-4d78-afb6-a3a836cff2d7 for instance 3a478b90-1417-492e-88c5-171aa3fa7eee on hv-cinder-85220 Sep 06 22:51:31.798163 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-8125a113-b188-4a87-a15d-1cc335d73fbd req-2504212f-be49-466d-bf07-6a99aeac947a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032599 Sep 06 22:51:31.798859 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 466/939] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 22:51:31.830919 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-06f6146f-2cba-4b56-82ef-fce5e63c4947 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:51:31.841457 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-06f6146f-2cba-4b56-82ef-fce5e63c4947 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc" status: 200 len: 1366 microversion: 2.1 time: 0.237646 Sep 06 22:51:31.842662 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 474/940] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:51:31 2022] GET /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:51:32.866659 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5dd05fdb-7dfb-48c4-ab2f-0d1743335ed5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:51:32.867724 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5dd05fdb-7dfb-48c4-ab2f-0d1743335ed5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:51:32.874234 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5dd05fdb-7dfb-48c4-ab2f-0d1743335ed5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:32.874800 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5dd05fdb-7dfb-48c4-ab2f-0d1743335ed5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:32.875307 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5dd05fdb-7dfb-48c4-ab2f-0d1743335ed5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:32.876073 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5dd05fdb-7dfb-48c4-ab2f-0d1743335ed5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:32.876597 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5dd05fdb-7dfb-48c4-ab2f-0d1743335ed5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:32.877152 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5dd05fdb-7dfb-48c4-ab2f-0d1743335ed5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:33.201195 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5dd05fdb-7dfb-48c4-ab2f-0d1743335ed5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:51:33.209524 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5dd05fdb-7dfb-48c4-ab2f-0d1743335ed5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc" status: 200 len: 1366 microversion: 2.1 time: 0.348439 Sep 06 22:51:33.210095 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 467/941] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:51:32 2022] GET /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc => generated 1366 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:51:34.231390 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-536425ce-47e9-4266-998d-251d57e40248 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:51:34.231993 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-536425ce-47e9-4266-998d-251d57e40248 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:51:34.238626 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-536425ce-47e9-4266-998d-251d57e40248 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:34.239099 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-536425ce-47e9-4266-998d-251d57e40248 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:34.239527 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-536425ce-47e9-4266-998d-251d57e40248 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:34.240207 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-536425ce-47e9-4266-998d-251d57e40248 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:34.240649 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-536425ce-47e9-4266-998d-251d57e40248 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:34.241168 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-536425ce-47e9-4266-998d-251d57e40248 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:34.372540 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-536425ce-47e9-4266-998d-251d57e40248 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:51:34.380084 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-536425ce-47e9-4266-998d-251d57e40248 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc" status: 200 len: 1366 microversion: 2.1 time: 0.152594 Sep 06 22:51:34.380647 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 475/942] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:51:34 2022] GET /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:51:35.403502 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f7a02c34-5ae7-4191-99eb-3f5c9f6cab64 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:51:35.404099 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f7a02c34-5ae7-4191-99eb-3f5c9f6cab64 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:51:35.411443 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f7a02c34-5ae7-4191-99eb-3f5c9f6cab64 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:35.411925 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f7a02c34-5ae7-4191-99eb-3f5c9f6cab64 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:35.412349 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f7a02c34-5ae7-4191-99eb-3f5c9f6cab64 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:35.413154 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f7a02c34-5ae7-4191-99eb-3f5c9f6cab64 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:35.413599 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f7a02c34-5ae7-4191-99eb-3f5c9f6cab64 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:35.414070 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f7a02c34-5ae7-4191-99eb-3f5c9f6cab64 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:35.430053 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-4a3a14e5-e22e-4c87-83c4-b5d9728dd1f7 req-8c250cbe-08ea-4816-83e1-530d8ea6e172 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60e1fda2-c9b3-48ff-a9f5-18ce551b70dc", "name": "network-vif-plugged", "status": "completed", "tag": "3021d148-87a0-4bfe-b540-8b533f38df53"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:51:35.443577 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-4a3a14e5-e22e-4c87-83c4-b5d9728dd1f7 req-8c250cbe-08ea-4816-83e1-530d8ea6e172 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:35.444906 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-4a3a14e5-e22e-4c87-83c4-b5d9728dd1f7 req-8c250cbe-08ea-4816-83e1-530d8ea6e172 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:35.446902 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-4a3a14e5-e22e-4c87-83c4-b5d9728dd1f7 req-8c250cbe-08ea-4816-83e1-530d8ea6e172 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:35.458565 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-4a3a14e5-e22e-4c87-83c4-b5d9728dd1f7 req-8c250cbe-08ea-4816-83e1-530d8ea6e172 service nova] Creating event network-vif-plugged:3021d148-87a0-4bfe-b540-8b533f38df53 for instance 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc on hv-cinder-85220 Sep 06 22:51:35.463878 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-4a3a14e5-e22e-4c87-83c4-b5d9728dd1f7 req-8c250cbe-08ea-4816-83e1-530d8ea6e172 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039114 Sep 06 22:51:35.464671 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 476/943] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 22:51:35.553691 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f7a02c34-5ae7-4191-99eb-3f5c9f6cab64 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:51:35.561504 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f7a02c34-5ae7-4191-99eb-3f5c9f6cab64 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc" status: 200 len: 1366 microversion: 2.1 time: 0.161789 Sep 06 22:51:35.562165 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 468/944] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:51:35 2022] GET /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:51:36.585682 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e915ecc8-5125-4ef6-9671-56fc83c8585a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:51:36.586369 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e915ecc8-5125-4ef6-9671-56fc83c8585a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:51:36.593121 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e915ecc8-5125-4ef6-9671-56fc83c8585a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:36.593624 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e915ecc8-5125-4ef6-9671-56fc83c8585a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:36.594049 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e915ecc8-5125-4ef6-9671-56fc83c8585a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:36.594732 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e915ecc8-5125-4ef6-9671-56fc83c8585a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:36.595176 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e915ecc8-5125-4ef6-9671-56fc83c8585a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:36.595591 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e915ecc8-5125-4ef6-9671-56fc83c8585a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:36.723234 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e915ecc8-5125-4ef6-9671-56fc83c8585a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:51:36.731078 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e915ecc8-5125-4ef6-9671-56fc83c8585a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc" status: 200 len: 1366 microversion: 2.1 time: 0.149908 Sep 06 22:51:36.735977 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 477/945] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:51:36 2022] GET /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:51:37.755533 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-68f501a7-799d-4cb6-a182-994513d06027 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:51:37.756140 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-68f501a7-799d-4cb6-a182-994513d06027 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:51:37.762622 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-68f501a7-799d-4cb6-a182-994513d06027 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:37.763102 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-68f501a7-799d-4cb6-a182-994513d06027 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:37.763531 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-68f501a7-799d-4cb6-a182-994513d06027 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:37.764215 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-68f501a7-799d-4cb6-a182-994513d06027 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:37.764662 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-68f501a7-799d-4cb6-a182-994513d06027 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:37.765105 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-68f501a7-799d-4cb6-a182-994513d06027 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:37.897079 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-68f501a7-799d-4cb6-a182-994513d06027 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:51:37.904610 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-68f501a7-799d-4cb6-a182-994513d06027 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc" status: 200 len: 1555 microversion: 2.1 time: 0.153002 Sep 06 22:51:37.905459 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 469/946] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:51:37 2022] GET /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:51:37.928629 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-2cd41350-d4d0-475b-8e26-2e2df9a651fb tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:51:37.929189 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-2cd41350-d4d0-475b-8e26-2e2df9a651fb tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:51:37.935430 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2cd41350-d4d0-475b-8e26-2e2df9a651fb tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:37.935901 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2cd41350-d4d0-475b-8e26-2e2df9a651fb tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:37.936327 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2cd41350-d4d0-475b-8e26-2e2df9a651fb tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:37.937067 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2cd41350-d4d0-475b-8e26-2e2df9a651fb tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:37.937511 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2cd41350-d4d0-475b-8e26-2e2df9a651fb tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:37.937926 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2cd41350-d4d0-475b-8e26-2e2df9a651fb tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:38.013333 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-2cd41350-d4d0-475b-8e26-2e2df9a651fb tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088526 Sep 06 22:51:38.013924 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 478/947] 10.222.0.39 () {58 vars in 1275 bytes} [Tue Sep 6 22:51:37 2022] GET /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:51:38.934551 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-e2f374db-5afd-4aab-997a-d601c3a3af68 req-9b706508-7e49-489f-9890-00a4fd8ffca9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60e1fda2-c9b3-48ff-a9f5-18ce551b70dc", "tag": "3021d148-87a0-4bfe-b540-8b533f38df53"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:51:38.939574 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=6 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:51:38.946815 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-e2f374db-5afd-4aab-997a-d601c3a3af68 req-9b706508-7e49-489f-9890-00a4fd8ffca9 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:51:38.947367 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-e2f374db-5afd-4aab-997a-d601c3a3af68 req-9b706508-7e49-489f-9890-00a4fd8ffca9 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:51:38.947857 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-e2f374db-5afd-4aab-997a-d601c3a3af68 req-9b706508-7e49-489f-9890-00a4fd8ffca9 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:51:38.959237 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-e2f374db-5afd-4aab-997a-d601c3a3af68 req-9b706508-7e49-489f-9890-00a4fd8ffca9 service nova] Creating event network-changed:3021d148-87a0-4bfe-b540-8b533f38df53 for instance 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc on hv-cinder-85220 Sep 06 22:51:38.964191 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-e2f374db-5afd-4aab-997a-d601c3a3af68 req-9b706508-7e49-489f-9890-00a4fd8ffca9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033329 Sep 06 22:51:38.964853 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 470/948] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:52:13.751726 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=2 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:52:13.752513 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=6 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:52:13.753803 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:52:13.754418 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:52:13.759686 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-5e0f9e82-d7b4-4e0e-a878-f312d75981a7 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:52:13.760161 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-5e0f9e82-d7b4-4e0e-a878-f312d75981a7 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:52:13.768487 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e0f9e82-d7b4-4e0e-a878-f312d75981a7 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:13.769004 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e0f9e82-d7b4-4e0e-a878-f312d75981a7 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:13.769433 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e0f9e82-d7b4-4e0e-a878-f312d75981a7 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:13.770103 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e0f9e82-d7b4-4e0e-a878-f312d75981a7 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:13.770540 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e0f9e82-d7b4-4e0e-a878-f312d75981a7 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:13.770947 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5e0f9e82-d7b4-4e0e-a878-f312d75981a7 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:13.795444 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-5e0f9e82-d7b4-4e0e-a878-f312d75981a7 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc/ips" status: 200 len: 149 microversion: 2.1 time: 0.044542 Sep 06 22:52:13.796004 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 479/949] 10.222.0.39 () {58 vars in 1248 bytes} [Tue Sep 6 22:52:13 2022] GET /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:52:13.805719 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:52:13.806660 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=72 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:52:13.810870 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6fe44153-38e6-400d-a984-8dde3460b693 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88410187-ebcf-40fe-adf9-be927ecb57ae"}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:52:13.813280 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6fe44153-38e6-400d-a984-8dde3460b693 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:52:13.821488 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6fe44153-38e6-400d-a984-8dde3460b693 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:13.821964 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6fe44153-38e6-400d-a984-8dde3460b693 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:13.822400 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6fe44153-38e6-400d-a984-8dde3460b693 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:13.823116 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6fe44153-38e6-400d-a984-8dde3460b693 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:13.823599 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6fe44153-38e6-400d-a984-8dde3460b693 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:13.824020 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6fe44153-38e6-400d-a984-8dde3460b693 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:13.902049 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-6fe44153-38e6-400d-a984-8dde3460b693 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] HTTP exception thrown: Invalid volume: volume 88410187-ebcf-40fe-adf9-be927ecb57ae is already attached to instances: a55ba753-4ee6-4731-b85e-ea1bc484bc97 Sep 06 22:52:13.903788 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6fe44153-38e6-400d-a984-8dde3460b693 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Request method failure captured: Sep 06 22:52:13.903788 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: request: POST /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc/os-volume_attachments HTTP/1.1 Sep 06 22:52:13.903788 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept: application/json Sep 06 22:52:13.903788 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Sep 06 22:52:13.903788 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Connection: close Sep 06 22:52:13.903788 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Length: 74 Sep 06 22:52:13.903788 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Type: application/json Sep 06 22:52:13.903788 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Host: 10.222.0.39 Sep 06 22:52:13.903788 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Sep 06 22:52:13.903788 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Sep 06 22:52:13.903788 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjF860yKGQSLzL5EmeXxXOacXOJOW7YjEJzU9q80MmpLf3abcjPgkwkUPc6JOe1BRsM08337WKjAQrMm7AibqPFxmuyJrmgvNBRnHTPCa8PNxKU8dZ5zs6S9shebBFRqMGenCSLIg7DtQDL1gVEhFL4BINUiinxCv43fRbm7ipIKDFqDQ Sep 06 22:52:13.903788 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Sep 06 22:52:13.903788 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Sep 06 22:52:13.903788 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Sep 06 22:52:13.903788 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Sep 06 22:52:13.903788 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Sep 06 22:52:13.903788 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Sep 06 22:52:13.903788 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Id: 121c13a143f447a1822f8df04b1a31a5 Sep 06 22:52:13.903788 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:52:13.903788 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Role: reader,member Sep 06 22:52:13.903788 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Sep 06 22:52:13.909741 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/121c13a143f447a1822f8df04b1a31a5"}]}] Sep 06 22:52:13.909741 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:52:13.909741 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 121c13a143f447a1822f8df04b1a31a5 Sep 06 22:52:13.909741 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:52:13.909741 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeNegativeTest-983971359-project Sep 06 22:52:13.909741 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Sep 06 22:52:13.909741 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Sep 06 22:52:13.909741 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Id: 68515ffe51b74aacb09e8584346e6db3 Sep 06 22:52:13.909741 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeNegativeTest-983971359-project Sep 06 22:52:13.909741 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Sep 06 22:52:13.909741 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: {"volumeAttachment": {"volumeId": "88410187-ebcf-40fe-adf9-be927ecb57ae"}} Sep 06 22:52:13.909741 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: method: > Sep 06 22:52:13.910757 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: exception: Invalid volume: volume 88410187-ebcf-40fe-adf9-be927ecb57ae is already attached to instances: a55ba753-4ee6-4731-b85e-ea1bc484bc97 Sep 06 22:52:13.910757 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: action_args: {'server_id': '60e1fda2-c9b3-48ff-a9f5-18ce551b70dc', 'body': {'volumeAttachment': {'volumeId': '88410187-ebcf-40fe-adf9-be927ecb57ae'}}} Sep 06 22:52:13.910757 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:52:13.910757 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:52:13.910757 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 06 22:52:13.910757 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 06 22:52:13.910757 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 22:52:13.910757 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 22:52:13.910757 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 06 22:52:13.910757 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 06 22:52:13.910757 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 06 22:52:13.910757 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 06 22:52:13.910757 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 06 22:52:13.910757 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 06 22:52:13.910757 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 88410187-ebcf-40fe-adf9-be927ecb57ae is already attached to instances: a55ba753-4ee6-4731-b85e-ea1bc484bc97 Sep 06 22:52:13.910757 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:52:13.910757 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:52:13.910757 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:52:13.910757 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:52:13.912289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:52:13.912289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:52:13.912289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:52:13.912289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:52:13.912289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:52:13.912289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:52:13.912289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 22:52:13.912289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 22:52:13.912289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 22:52:13.912289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 22:52:13.912289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 22:52:13.912289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 22:52:13.912289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 06 22:52:13.912289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 06 22:52:13.912289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 88410187-ebcf-40fe-adf9-be927ecb57ae is already attached to instances: a55ba753-4ee6-4731-b85e-ea1bc484bc97 Sep 06 22:52:13.912289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:52:13.912289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:52:13.912289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:52:13.912289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:52:13.912289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:52:13.913886 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:52:13.913886 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:52:13.913886 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:52:13.913886 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 88410187-ebcf-40fe-adf9-be927ecb57ae is already attached to instances: a55ba753-4ee6-4731-b85e-ea1bc484bc97 Sep 06 22:52:13.913886 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:52:13.913886 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6fe44153-38e6-400d-a984-8dde3460b693 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Returning 400 to user: Invalid volume: volume 88410187-ebcf-40fe-adf9-be927ecb57ae is already attached to instances: a55ba753-4ee6-4731-b85e-ea1bc484bc97 {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:52:13.913886 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6fe44153-38e6-400d-a984-8dde3460b693 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "POST /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101583 Sep 06 22:52:13.913886 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 471/950] 10.222.0.39 () {60 vars in 1323 bytes} [Tue Sep 6 22:52:13 2022] POST /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 22:52:13.915066 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b4834205-3bb7-452c-90e5-fbc9d5352eff tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:52:13.915159 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b4834205-3bb7-452c-90e5-fbc9d5352eff tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:52:13.920960 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b4834205-3bb7-452c-90e5-fbc9d5352eff tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:13.921424 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b4834205-3bb7-452c-90e5-fbc9d5352eff tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:13.921843 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b4834205-3bb7-452c-90e5-fbc9d5352eff tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:13.922514 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b4834205-3bb7-452c-90e5-fbc9d5352eff tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:13.922949 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b4834205-3bb7-452c-90e5-fbc9d5352eff tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:13.923356 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b4834205-3bb7-452c-90e5-fbc9d5352eff tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:13.947875 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b4834205-3bb7-452c-90e5-fbc9d5352eff tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc] Going to try to terminate instance {{(pid=127087) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 22:52:14.022596 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b4834205-3bb7-452c-90e5-fbc9d5352eff tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "DELETE /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc" status: 204 len: 0 microversion: 2.1 time: 0.112009 Sep 06 22:52:14.023315 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 480/951] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Sep 6 22:52:13 2022] DELETE /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 22:52:14.032231 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8e843b42-d555-4b2a-bd47-51b3d8936b64 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:52:14.032920 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8e843b42-d555-4b2a-bd47-51b3d8936b64 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:52:14.040628 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8e843b42-d555-4b2a-bd47-51b3d8936b64 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:14.041110 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8e843b42-d555-4b2a-bd47-51b3d8936b64 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:14.041542 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8e843b42-d555-4b2a-bd47-51b3d8936b64 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:14.042254 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8e843b42-d555-4b2a-bd47-51b3d8936b64 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:14.042697 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8e843b42-d555-4b2a-bd47-51b3d8936b64 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:14.043117 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8e843b42-d555-4b2a-bd47-51b3d8936b64 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:14.176481 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8e843b42-d555-4b2a-bd47-51b3d8936b64 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:52:14.184537 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8e843b42-d555-4b2a-bd47-51b3d8936b64 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc" status: 200 len: 1680 microversion: 2.1 time: 0.156475 Sep 06 22:52:14.185124 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 472/952] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:52:14 2022] GET /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:52:15.207982 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f90bef1f-8dc2-4a23-86bd-86457b32006e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:52:15.208679 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-f90bef1f-8dc2-4a23-86bd-86457b32006e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:52:15.215281 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f90bef1f-8dc2-4a23-86bd-86457b32006e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:15.215755 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f90bef1f-8dc2-4a23-86bd-86457b32006e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:15.216183 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f90bef1f-8dc2-4a23-86bd-86457b32006e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:15.216890 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f90bef1f-8dc2-4a23-86bd-86457b32006e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:15.217336 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f90bef1f-8dc2-4a23-86bd-86457b32006e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:15.217753 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-f90bef1f-8dc2-4a23-86bd-86457b32006e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:15.346206 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-f90bef1f-8dc2-4a23-86bd-86457b32006e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:52:15.354648 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-f90bef1f-8dc2-4a23-86bd-86457b32006e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc" status: 200 len: 1680 microversion: 2.1 time: 0.150879 Sep 06 22:52:15.355208 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 481/953] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:52:15 2022] GET /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:52:16.378952 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-2e8f41a2-6fd9-4d10-8f10-040d38c43bd1 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:52:16.379657 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-2e8f41a2-6fd9-4d10-8f10-040d38c43bd1 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:52:16.386626 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e8f41a2-6fd9-4d10-8f10-040d38c43bd1 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:16.387098 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e8f41a2-6fd9-4d10-8f10-040d38c43bd1 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:16.387524 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e8f41a2-6fd9-4d10-8f10-040d38c43bd1 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:16.388205 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e8f41a2-6fd9-4d10-8f10-040d38c43bd1 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:16.388649 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e8f41a2-6fd9-4d10-8f10-040d38c43bd1 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:16.389088 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-2e8f41a2-6fd9-4d10-8f10-040d38c43bd1 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:16.486532 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-2e8f41a2-6fd9-4d10-8f10-040d38c43bd1 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:52:16.494730 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-2e8f41a2-6fd9-4d10-8f10-040d38c43bd1 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc" status: 200 len: 1613 microversion: 2.1 time: 0.119599 Sep 06 22:52:16.495297 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 473/954] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:52:16 2022] GET /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc => generated 1613 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:52:16.567755 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-a138cd85-5c6b-4a30-b8cc-df5b79e881d6 req-a7a63aa5-6012-4846-91fe-d90c94318f9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60e1fda2-c9b3-48ff-a9f5-18ce551b70dc", "name": "network-vif-deleted", "tag": "3021d148-87a0-4bfe-b540-8b533f38df53"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:52:16.577573 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-a138cd85-5c6b-4a30-b8cc-df5b79e881d6 req-a7a63aa5-6012-4846-91fe-d90c94318f9e service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:16.578050 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-a138cd85-5c6b-4a30-b8cc-df5b79e881d6 req-a7a63aa5-6012-4846-91fe-d90c94318f9e service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:16.578471 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-a138cd85-5c6b-4a30-b8cc-df5b79e881d6 req-a7a63aa5-6012-4846-91fe-d90c94318f9e service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:16.594520 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-a138cd85-5c6b-4a30-b8cc-df5b79e881d6 req-a7a63aa5-6012-4846-91fe-d90c94318f9e service nova] Creating event network-vif-deleted:3021d148-87a0-4bfe-b540-8b533f38df53 for instance 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc on hv-cinder-85220 Sep 06 22:52:16.600485 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-a138cd85-5c6b-4a30-b8cc-df5b79e881d6 req-a7a63aa5-6012-4846-91fe-d90c94318f9e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036285 Sep 06 22:52:16.601173 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 482/955] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:52:17.520004 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-82a43953-08da-40db-b438-20d9d49cba83 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:52:17.520697 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-82a43953-08da-40db-b438-20d9d49cba83 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:52:17.527913 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-82a43953-08da-40db-b438-20d9d49cba83 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:17.528492 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-82a43953-08da-40db-b438-20d9d49cba83 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:17.529032 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-82a43953-08da-40db-b438-20d9d49cba83 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:17.529749 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-82a43953-08da-40db-b438-20d9d49cba83 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:17.530199 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-82a43953-08da-40db-b438-20d9d49cba83 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:17.530622 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-82a43953-08da-40db-b438-20d9d49cba83 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:17.545582 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-82a43953-08da-40db-b438-20d9d49cba83 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] HTTP exception thrown: Instance 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc could not be found. Sep 06 22:52:17.547130 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-82a43953-08da-40db-b438-20d9d49cba83 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Request method failure captured: Sep 06 22:52:17.547130 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc HTTP/1.1 Sep 06 22:52:17.547130 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept: application/json Sep 06 22:52:17.547130 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Sep 06 22:52:17.547130 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Connection: close Sep 06 22:52:17.547130 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Length: 0 Sep 06 22:52:17.547130 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Type: application/json Sep 06 22:52:17.547130 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Host: 10.222.0.39 Sep 06 22:52:17.547130 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Sep 06 22:52:17.547130 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Sep 06 22:52:17.547130 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjF860yKGQSLzL5EmeXxXOacXOJOW7YjEJzU9q80MmpLf3abcjPgkwkUPc6JOe1BRsM08337WKjAQrMm7AibqPFxmuyJrmgvNBRnHTPCa8PNxKU8dZ5zs6S9shebBFRqMGenCSLIg7DtQDL1gVEhFL4BINUiinxCv43fRbm7ipIKDFqDQ Sep 06 22:52:17.547130 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Sep 06 22:52:17.547130 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Sep 06 22:52:17.547130 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Sep 06 22:52:17.547130 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Sep 06 22:52:17.547130 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Sep 06 22:52:17.547130 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Sep 06 22:52:17.547130 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Id: 121c13a143f447a1822f8df04b1a31a5 Sep 06 22:52:17.547130 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:52:17.547130 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Role: reader,member Sep 06 22:52:17.547130 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Sep 06 22:52:17.548601 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/121c13a143f447a1822f8df04b1a31a5"}]}] Sep 06 22:52:17.548601 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:52:17.548601 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 121c13a143f447a1822f8df04b1a31a5 Sep 06 22:52:17.548601 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:52:17.548601 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeNegativeTest-983971359-project Sep 06 22:52:17.548601 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Sep 06 22:52:17.548601 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Sep 06 22:52:17.548601 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Id: 68515ffe51b74aacb09e8584346e6db3 Sep 06 22:52:17.548601 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeNegativeTest-983971359-project Sep 06 22:52:17.548601 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: method: > Sep 06 22:52:17.548601 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: exception: Instance 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc could not be found. Sep 06 22:52:17.548601 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: action_args: {'id': '60e1fda2-c9b3-48ff-a9f5-18ce551b70dc'} Sep 06 22:52:17.549595 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:52:17.549595 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:52:17.549595 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:52:17.549595 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:52:17.549595 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:52:17.549595 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:52:17.549595 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:52:17.549595 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:52:17.549595 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:52:17.549595 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:52:17.549595 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc could not be found. Sep 06 22:52:17.549595 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:52:17.549595 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:52:17.549595 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:52:17.549595 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:52:17.549595 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:52:17.549595 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:52:17.549595 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:52:17.549595 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:52:17.549595 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:52:17.551782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:52:17.551782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 22:52:17.551782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 22:52:17.551782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:52:17.551782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:52:17.551782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:52:17.551782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:52:17.551782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc could not be found. Sep 06 22:52:17.551782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:52:17.551782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:52:17.551782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:52:17.551782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:52:17.551782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:52:17.551782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:52:17.551782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:52:17.551782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:52:17.551782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc could not be found. Sep 06 22:52:17.551782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:52:17.553128 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-82a43953-08da-40db-b438-20d9d49cba83 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Returning 404 to user: Instance 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:52:17.553128 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-82a43953-08da-40db-b438-20d9d49cba83 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc" status: 404 len: 111 microversion: 2.1 time: 0.032802 Sep 06 22:52:17.553128 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 474/956] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:52:17 2022] GET /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 22:52:17.558400 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b2d00170-bde8-4e13-b1e5-e010c8b3fe0f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '.version_select at 0x7f9c52ea6940>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:52:17.582574 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b2d00170-bde8-4e13-b1e5-e010c8b3fe0f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-887454961" status: 202 len: 0 microversion: 2.1 time: 0.028039 Sep 06 22:52:17.583139 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 483/957] 10.222.0.39 () {58 vars in 1218 bytes} [Tue Sep 6 22:52:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-887454961 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 22:52:18.244699 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e56dbe3a-fa37-47ec-879e-980641009e79 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:52:18.245249 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e56dbe3a-fa37-47ec-879e-980641009e79 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: a55ba753-4ee6-4731-b85e-ea1bc484bc97] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:52:18.251135 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e56dbe3a-fa37-47ec-879e-980641009e79 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:18.251616 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e56dbe3a-fa37-47ec-879e-980641009e79 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:18.252043 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e56dbe3a-fa37-47ec-879e-980641009e79 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:18.252724 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e56dbe3a-fa37-47ec-879e-980641009e79 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:18.253202 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e56dbe3a-fa37-47ec-879e-980641009e79 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:18.253624 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e56dbe3a-fa37-47ec-879e-980641009e79 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:18.334687 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-e56dbe3a-fa37-47ec-879e-980641009e79 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lazy-loading 'services' on Instance uuid a55ba753-4ee6-4731-b85e-ea1bc484bc97 {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 22:52:18.404464 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e56dbe3a-fa37-47ec-879e-980641009e79 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97/os-volume_attachments/88410187-ebcf-40fe-adf9-be927ecb57ae" status: 202 len: 0 microversion: 2.1 time: 0.164097 Sep 06 22:52:18.405079 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 475/958] 10.222.0.39 () {58 vars in 1416 bytes} [Tue Sep 6 22:52:18 2022] DELETE /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97/os-volume_attachments/88410187-ebcf-40fe-adf9-be927ecb57ae => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 22:52:18.414506 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-29548fe1-fc29-462d-a458-c0c32ef86783 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:52:18.416914 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-29548fe1-fc29-462d-a458-c0c32ef86783 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: a55ba753-4ee6-4731-b85e-ea1bc484bc97] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:52:18.424165 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-29548fe1-fc29-462d-a458-c0c32ef86783 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:18.424782 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-29548fe1-fc29-462d-a458-c0c32ef86783 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:18.425282 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-29548fe1-fc29-462d-a458-c0c32ef86783 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:18.426561 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-29548fe1-fc29-462d-a458-c0c32ef86783 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:18.427283 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-29548fe1-fc29-462d-a458-c0c32ef86783 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:18.427718 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-29548fe1-fc29-462d-a458-c0c32ef86783 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:18.461113 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-29548fe1-fc29-462d-a458-c0c32ef86783 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050797 Sep 06 22:52:18.462256 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 484/959] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Sep 6 22:52:18 2022] GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:52:19.475482 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a65ab064-becb-4ed1-80d0-f915815534a4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:52:19.478384 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a65ab064-becb-4ed1-80d0-f915815534a4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: a55ba753-4ee6-4731-b85e-ea1bc484bc97] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:52:19.484455 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a65ab064-becb-4ed1-80d0-f915815534a4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:19.484969 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a65ab064-becb-4ed1-80d0-f915815534a4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:19.485395 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a65ab064-becb-4ed1-80d0-f915815534a4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:19.486069 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a65ab064-becb-4ed1-80d0-f915815534a4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:19.486512 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a65ab064-becb-4ed1-80d0-f915815534a4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:19.486925 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a65ab064-becb-4ed1-80d0-f915815534a4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:19.514966 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a65ab064-becb-4ed1-80d0-f915815534a4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044460 Sep 06 22:52:19.515496 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 476/960] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Sep 6 22:52:19 2022] GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 22:52:19.578516 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-77e26398-ee8c-433b-9391-078141778b5c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:52:19.579011 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-77e26398-ee8c-433b-9391-078141778b5c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: a55ba753-4ee6-4731-b85e-ea1bc484bc97] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:52:19.585706 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-77e26398-ee8c-433b-9391-078141778b5c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:19.586187 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-77e26398-ee8c-433b-9391-078141778b5c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:19.587134 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-77e26398-ee8c-433b-9391-078141778b5c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:19.587820 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-77e26398-ee8c-433b-9391-078141778b5c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:19.588268 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-77e26398-ee8c-433b-9391-078141778b5c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:19.588688 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-77e26398-ee8c-433b-9391-078141778b5c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:19.613601 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-77e26398-ee8c-433b-9391-078141778b5c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: a55ba753-4ee6-4731-b85e-ea1bc484bc97] Going to try to terminate instance {{(pid=127087) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 22:52:19.690678 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-77e26398-ee8c-433b-9391-078141778b5c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97" status: 204 len: 0 microversion: 2.1 time: 0.115622 Sep 06 22:52:19.691553 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 485/961] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Sep 6 22:52:19 2022] DELETE /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 22:52:19.700574 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b37be527-beee-40b3-84c9-1c6bec25d1c8 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:52:19.701220 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b37be527-beee-40b3-84c9-1c6bec25d1c8 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: a55ba753-4ee6-4731-b85e-ea1bc484bc97] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:52:19.707043 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b37be527-beee-40b3-84c9-1c6bec25d1c8 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:19.707524 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b37be527-beee-40b3-84c9-1c6bec25d1c8 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:19.707950 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b37be527-beee-40b3-84c9-1c6bec25d1c8 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:19.708631 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b37be527-beee-40b3-84c9-1c6bec25d1c8 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:19.709110 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b37be527-beee-40b3-84c9-1c6bec25d1c8 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:19.709525 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b37be527-beee-40b3-84c9-1c6bec25d1c8 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:19.838835 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b37be527-beee-40b3-84c9-1c6bec25d1c8 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:52:19.847465 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b37be527-beee-40b3-84c9-1c6bec25d1c8 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97" status: 200 len: 1680 microversion: 2.1 time: 0.150990 Sep 06 22:52:19.848029 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 477/962] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:52:19 2022] GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:52:20.870883 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-44b33a1d-e391-449d-8653-663cc6ae0623 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:52:20.871609 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-44b33a1d-e391-449d-8653-663cc6ae0623 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: a55ba753-4ee6-4731-b85e-ea1bc484bc97] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:52:20.877881 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-44b33a1d-e391-449d-8653-663cc6ae0623 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:20.878365 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-44b33a1d-e391-449d-8653-663cc6ae0623 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:20.878792 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-44b33a1d-e391-449d-8653-663cc6ae0623 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:20.879474 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-44b33a1d-e391-449d-8653-663cc6ae0623 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:20.879922 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-44b33a1d-e391-449d-8653-663cc6ae0623 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:20.880337 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-44b33a1d-e391-449d-8653-663cc6ae0623 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:21.012285 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-44b33a1d-e391-449d-8653-663cc6ae0623 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:52:21.019890 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-44b33a1d-e391-449d-8653-663cc6ae0623 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97" status: 200 len: 1680 microversion: 2.1 time: 0.153375 Sep 06 22:52:21.020446 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 486/963] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:52:20 2022] GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:52:22.047441 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f4eecda8-3ced-47b7-8fe5-40c9bc8bbbad tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:52:22.048486 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f4eecda8-3ced-47b7-8fe5-40c9bc8bbbad tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: a55ba753-4ee6-4731-b85e-ea1bc484bc97] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:52:22.055251 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4eecda8-3ced-47b7-8fe5-40c9bc8bbbad tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:22.055762 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4eecda8-3ced-47b7-8fe5-40c9bc8bbbad tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:22.056200 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4eecda8-3ced-47b7-8fe5-40c9bc8bbbad tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:22.056973 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4eecda8-3ced-47b7-8fe5-40c9bc8bbbad tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:22.057438 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4eecda8-3ced-47b7-8fe5-40c9bc8bbbad tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:22.057851 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f4eecda8-3ced-47b7-8fe5-40c9bc8bbbad tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:22.150211 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f4eecda8-3ced-47b7-8fe5-40c9bc8bbbad tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:52:22.158271 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f4eecda8-3ced-47b7-8fe5-40c9bc8bbbad tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97" status: 200 len: 1613 microversion: 2.1 time: 0.118708 Sep 06 22:52:22.158806 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 478/964] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:52:22 2022] GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97 => generated 1613 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:52:22.215843 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-fa57d7d8-8f7d-4305-aae0-4aad0099e715 req-281a0154-fb99-46f7-983c-c1add716ae6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a55ba753-4ee6-4731-b85e-ea1bc484bc97", "name": "network-vif-deleted", "tag": "cad81a42-7a18-4bf8-bd81-ef1a4f8de70e"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:52:22.228210 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-fa57d7d8-8f7d-4305-aae0-4aad0099e715 req-281a0154-fb99-46f7-983c-c1add716ae6b service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:22.229092 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-fa57d7d8-8f7d-4305-aae0-4aad0099e715 req-281a0154-fb99-46f7-983c-c1add716ae6b service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:22.229766 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-fa57d7d8-8f7d-4305-aae0-4aad0099e715 req-281a0154-fb99-46f7-983c-c1add716ae6b service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:22.242995 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-fa57d7d8-8f7d-4305-aae0-4aad0099e715 req-281a0154-fb99-46f7-983c-c1add716ae6b service nova] Creating event network-vif-deleted:cad81a42-7a18-4bf8-bd81-ef1a4f8de70e for instance a55ba753-4ee6-4731-b85e-ea1bc484bc97 on hv-cinder-85220 Sep 06 22:52:22.250228 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-fa57d7d8-8f7d-4305-aae0-4aad0099e715 req-281a0154-fb99-46f7-983c-c1add716ae6b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039676 Sep 06 22:52:22.251043 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 487/965] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:52:23.181907 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1b0da14c-fc4b-48bb-910a-5b1eb46b0832 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:52:23.183096 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1b0da14c-fc4b-48bb-910a-5b1eb46b0832 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: a55ba753-4ee6-4731-b85e-ea1bc484bc97] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:52:23.189454 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b0da14c-fc4b-48bb-910a-5b1eb46b0832 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:23.189927 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b0da14c-fc4b-48bb-910a-5b1eb46b0832 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:23.190358 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b0da14c-fc4b-48bb-910a-5b1eb46b0832 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:23.191042 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b0da14c-fc4b-48bb-910a-5b1eb46b0832 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:23.191489 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b0da14c-fc4b-48bb-910a-5b1eb46b0832 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:23.191903 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1b0da14c-fc4b-48bb-910a-5b1eb46b0832 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:23.205567 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-1b0da14c-fc4b-48bb-910a-5b1eb46b0832 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] HTTP exception thrown: Instance a55ba753-4ee6-4731-b85e-ea1bc484bc97 could not be found. Sep 06 22:52:23.208021 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1b0da14c-fc4b-48bb-910a-5b1eb46b0832 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Request method failure captured: Sep 06 22:52:23.208021 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97 HTTP/1.1 Sep 06 22:52:23.208021 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept: application/json Sep 06 22:52:23.208021 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Sep 06 22:52:23.208021 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Connection: close Sep 06 22:52:23.208021 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Length: 0 Sep 06 22:52:23.208021 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Type: application/json Sep 06 22:52:23.208021 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Host: 10.222.0.39 Sep 06 22:52:23.208021 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Sep 06 22:52:23.208021 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Sep 06 22:52:23.208021 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjF860yKGQSLzL5EmeXxXOacXOJOW7YjEJzU9q80MmpLf3abcjPgkwkUPc6JOe1BRsM08337WKjAQrMm7AibqPFxmuyJrmgvNBRnHTPCa8PNxKU8dZ5zs6S9shebBFRqMGenCSLIg7DtQDL1gVEhFL4BINUiinxCv43fRbm7ipIKDFqDQ Sep 06 22:52:23.208021 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Sep 06 22:52:23.208021 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Sep 06 22:52:23.208021 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Sep 06 22:52:23.208021 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Sep 06 22:52:23.208021 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Sep 06 22:52:23.208021 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Sep 06 22:52:23.208021 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Id: 121c13a143f447a1822f8df04b1a31a5 Sep 06 22:52:23.208021 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:52:23.208021 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Role: reader,member Sep 06 22:52:23.208021 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Sep 06 22:52:23.209710 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/121c13a143f447a1822f8df04b1a31a5"}]}] Sep 06 22:52:23.209710 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:52:23.209710 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 121c13a143f447a1822f8df04b1a31a5 Sep 06 22:52:23.209710 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:52:23.209710 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeNegativeTest-983971359-project Sep 06 22:52:23.209710 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Sep 06 22:52:23.209710 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Sep 06 22:52:23.209710 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Id: 68515ffe51b74aacb09e8584346e6db3 Sep 06 22:52:23.209710 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeNegativeTest-983971359-project Sep 06 22:52:23.209710 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: method: > Sep 06 22:52:23.209710 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: exception: Instance a55ba753-4ee6-4731-b85e-ea1bc484bc97 could not be found. Sep 06 22:52:23.209710 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: action_args: {'id': 'a55ba753-4ee6-4731-b85e-ea1bc484bc97'} Sep 06 22:52:23.210623 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:52:23.210623 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:52:23.210623 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:52:23.210623 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:52:23.210623 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:52:23.210623 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:52:23.210623 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:52:23.210623 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:52:23.210623 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:52:23.210623 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:52:23.210623 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a55ba753-4ee6-4731-b85e-ea1bc484bc97 could not be found. Sep 06 22:52:23.210623 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:52:23.210623 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:52:23.210623 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:52:23.210623 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:52:23.210623 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:52:23.210623 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:52:23.210623 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:52:23.210623 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:52:23.210623 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:52:23.212833 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:52:23.212833 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 22:52:23.212833 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 22:52:23.212833 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:52:23.212833 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:52:23.212833 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:52:23.212833 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:52:23.212833 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a55ba753-4ee6-4731-b85e-ea1bc484bc97 could not be found. Sep 06 22:52:23.212833 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:52:23.212833 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:52:23.212833 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:52:23.212833 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:52:23.212833 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:52:23.212833 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:52:23.212833 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:52:23.212833 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:52:23.212833 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a55ba753-4ee6-4731-b85e-ea1bc484bc97 could not be found. Sep 06 22:52:23.212833 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:52:23.215391 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1b0da14c-fc4b-48bb-910a-5b1eb46b0832 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Returning 404 to user: Instance a55ba753-4ee6-4731-b85e-ea1bc484bc97 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:52:23.215391 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1b0da14c-fc4b-48bb-910a-5b1eb46b0832 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97" status: 404 len: 111 microversion: 2.1 time: 0.032112 Sep 06 22:52:23.215391 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 479/966] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:52:23 2022] GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 22:52:23.219323 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-033ffea3-929e-446d-9adf-d4a27ec29b2d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '.version_select at 0x7f9c52ec6a60>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:52:23.239462 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-033ffea3-929e-446d-9adf-d4a27ec29b2d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1816169644" status: 202 len: 0 microversion: 2.1 time: 0.024179 Sep 06 22:52:23.240179 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 488/967] 10.222.0.39 () {58 vars in 1221 bytes} [Tue Sep 6 22:52:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1816169644 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 22:52:23.846106 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d8276519-aee0-43a7-90d7-5bed785d367b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Action: 'create', calling method: .version_select at 0x7f9c4f668790>, body: {"keypair": {"name": "tempest-keypair-1387781795", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCUqoVwNLgX6ccW7OkdMHhgxtz+9wCaLnMiPD/1w0GMCT0zE+MTqY9xDf/uYgL2bjK+zPyYcPeJoYzi13N9Y+VsF+rsbHWBq3lx8GBpfQuTX+CQycTXXXTL2sru2KlmbA=="}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:52:23.861255 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-d8276519-aee0-43a7-90d7-5bed785d367b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Getting quotas for project 121c13a143f447a1822f8df04b1a31a5. Resources: {'key_pairs'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 22:52:23.864974 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-d8276519-aee0-43a7-90d7-5bed785d367b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Getting quotas for user 68515ffe51b74aacb09e8584346e6db3 and project 121c13a143f447a1822f8df04b1a31a5. Resources: {'key_pairs'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 22:52:23.890301 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d8276519-aee0-43a7-90d7-5bed785d367b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048037 Sep 06 22:52:23.890891 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 480/968] 10.222.0.39 () {60 vars in 1159 bytes} [Tue Sep 6 22:52:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:52:25.083687 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ffbae7b5-931b-4d98-a335-db21c0e5cff4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1668167407", "imageRef": "93326d5e-4826-431e-9ad1-6ee2d44e48d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "11fd96bf-4fdb-44de-a3da-a6c9f281ae59"}], "security_groups": [{"name": "tempest-securitygroup--229123221"}], "key_name": "tempest-keypair-1387781795", "user_data": "}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:52:25.186482 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.network.neutron [None req-ffbae7b5-931b-4d98-a335-db21c0e5cff4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] validate_networks() for [('11fd96bf-4fdb-44de-a3da-a6c9f281ae59', None, None, None, None, None)] {{(pid=127087) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 22:52:25.547371 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-ffbae7b5-931b-4d98-a335-db21c0e5cff4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Flavor limits 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 22:52:25.547811 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-ffbae7b5-931b-4d98-a335-db21c0e5cff4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Image limits 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 22:52:25.548282 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-ffbae7b5-931b-4d98-a335-db21c0e5cff4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Flavor pref 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 22:52:25.548685 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-ffbae7b5-931b-4d98-a335-db21c0e5cff4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Image pref 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 22:52:25.549142 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-ffbae7b5-931b-4d98-a335-db21c0e5cff4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 22:52:25.558364 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ffbae7b5-931b-4d98-a335-db21c0e5cff4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:25.558840 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ffbae7b5-931b-4d98-a335-db21c0e5cff4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:25.559267 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ffbae7b5-931b-4d98-a335-db21c0e5cff4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:25.559987 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ffbae7b5-931b-4d98-a335-db21c0e5cff4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:25.560428 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ffbae7b5-931b-4d98-a335-db21c0e5cff4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:25.560874 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ffbae7b5-931b-4d98-a335-db21c0e5cff4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:25.577462 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-ffbae7b5-931b-4d98-a335-db21c0e5cff4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Getting quotas for project 121c13a143f447a1822f8df04b1a31a5. Resources: {'instances', 'ram', 'cores'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 22:52:25.581484 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-ffbae7b5-931b-4d98-a335-db21c0e5cff4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Getting quotas for user 68515ffe51b74aacb09e8584346e6db3 and project 121c13a143f447a1822f8df04b1a31a5. Resources: {'instances', 'ram', 'cores'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 22:52:25.592901 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ffbae7b5-931b-4d98-a335-db21c0e5cff4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Going to run 1 instances... {{(pid=127087) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 22:52:25.595255 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ffbae7b5-931b-4d98-a335-db21c0e5cff4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: dcccaffa-49b8-4d3f-b87d-c23204988c91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='93326d5e-4826-431e-9ad1-6ee2d44e48d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 22:52:25.645351 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ffbae7b5-931b-4d98-a335-db21c0e5cff4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.566385 Sep 06 22:52:25.645909 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 489/969] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Sep 6 22:52:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 22:52:25.659117 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-10c50e74-9857-40ac-bfae-ff24612c1f0b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:52:25.659727 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-10c50e74-9857-40ac-bfae-ff24612c1f0b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: dcccaffa-49b8-4d3f-b87d-c23204988c91] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:52:25.717171 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-10c50e74-9857-40ac-bfae-ff24612c1f0b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:52:25.724209 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-10c50e74-9857-40ac-bfae-ff24612c1f0b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91" status: 200 len: 1242 microversion: 2.1 time: 0.069679 Sep 06 22:52:25.724797 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 481/970] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:52:25 2022] GET /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91 => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:52:26.748555 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d3cf14dc-0b78-4b6a-976a-3d2d6ff4c5da tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:52:26.750077 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-d3cf14dc-0b78-4b6a-976a-3d2d6ff4c5da tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: dcccaffa-49b8-4d3f-b87d-c23204988c91] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:52:26.756266 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d3cf14dc-0b78-4b6a-976a-3d2d6ff4c5da tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:26.756744 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d3cf14dc-0b78-4b6a-976a-3d2d6ff4c5da tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:26.757212 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d3cf14dc-0b78-4b6a-976a-3d2d6ff4c5da tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:26.757899 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d3cf14dc-0b78-4b6a-976a-3d2d6ff4c5da tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:26.758340 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d3cf14dc-0b78-4b6a-976a-3d2d6ff4c5da tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:26.758756 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d3cf14dc-0b78-4b6a-976a-3d2d6ff4c5da tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:26.838354 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-d3cf14dc-0b78-4b6a-976a-3d2d6ff4c5da tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:52:26.846032 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d3cf14dc-0b78-4b6a-976a-3d2d6ff4c5da tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91" status: 200 len: 1312 microversion: 2.1 time: 0.102416 Sep 06 22:52:26.846599 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 490/971] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:52:26 2022] GET /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91 => generated 1312 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:52:27.870712 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-608aa3ee-dba4-4ca8-8f41-d9b98fa11224 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:52:27.871424 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-608aa3ee-dba4-4ca8-8f41-d9b98fa11224 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: dcccaffa-49b8-4d3f-b87d-c23204988c91] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:52:27.878065 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-608aa3ee-dba4-4ca8-8f41-d9b98fa11224 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:27.878539 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-608aa3ee-dba4-4ca8-8f41-d9b98fa11224 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:27.878966 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-608aa3ee-dba4-4ca8-8f41-d9b98fa11224 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:27.879657 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-608aa3ee-dba4-4ca8-8f41-d9b98fa11224 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:27.880096 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-608aa3ee-dba4-4ca8-8f41-d9b98fa11224 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:27.880508 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-608aa3ee-dba4-4ca8-8f41-d9b98fa11224 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:28.093076 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-608aa3ee-dba4-4ca8-8f41-d9b98fa11224 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:52:28.100838 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-608aa3ee-dba4-4ca8-8f41-d9b98fa11224 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91" status: 200 len: 1367 microversion: 2.1 time: 0.234964 Sep 06 22:52:28.101405 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 482/972] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:52:27 2022] GET /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:52:28.437893 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-093f5dc9-16c1-4dd8-9949-b7be65b4eaa5 req-af1dfcbe-d2e1-4ac2-8ffb-2c26d3e8c8be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcccaffa-49b8-4d3f-b87d-c23204988c91", "tag": "e9c46522-6be6-4f46-b035-7c1bf2e2c3ff"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:52:28.449649 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-093f5dc9-16c1-4dd8-9949-b7be65b4eaa5 req-af1dfcbe-d2e1-4ac2-8ffb-2c26d3e8c8be service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:28.450121 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-093f5dc9-16c1-4dd8-9949-b7be65b4eaa5 req-af1dfcbe-d2e1-4ac2-8ffb-2c26d3e8c8be service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:28.450730 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-093f5dc9-16c1-4dd8-9949-b7be65b4eaa5 req-af1dfcbe-d2e1-4ac2-8ffb-2c26d3e8c8be service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:28.463084 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-093f5dc9-16c1-4dd8-9949-b7be65b4eaa5 req-af1dfcbe-d2e1-4ac2-8ffb-2c26d3e8c8be service nova] Creating event network-changed:e9c46522-6be6-4f46-b035-7c1bf2e2c3ff for instance dcccaffa-49b8-4d3f-b87d-c23204988c91 on hv-cinder-85220 Sep 06 22:52:28.468460 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-093f5dc9-16c1-4dd8-9949-b7be65b4eaa5 req-af1dfcbe-d2e1-4ac2-8ffb-2c26d3e8c8be service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034769 Sep 06 22:52:28.469180 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 491/973] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:52:29.124914 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fa3e415e-4d7e-4402-9fc1-6234b7f3f171 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:52:29.125517 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fa3e415e-4d7e-4402-9fc1-6234b7f3f171 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: dcccaffa-49b8-4d3f-b87d-c23204988c91] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:52:29.132301 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fa3e415e-4d7e-4402-9fc1-6234b7f3f171 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:29.132789 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fa3e415e-4d7e-4402-9fc1-6234b7f3f171 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:29.133220 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fa3e415e-4d7e-4402-9fc1-6234b7f3f171 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:29.133906 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fa3e415e-4d7e-4402-9fc1-6234b7f3f171 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:29.134961 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fa3e415e-4d7e-4402-9fc1-6234b7f3f171 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:29.135545 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fa3e415e-4d7e-4402-9fc1-6234b7f3f171 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:29.266564 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fa3e415e-4d7e-4402-9fc1-6234b7f3f171 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:52:29.274147 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fa3e415e-4d7e-4402-9fc1-6234b7f3f171 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91" status: 200 len: 1367 microversion: 2.1 time: 0.153629 Sep 06 22:52:29.274753 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 483/974] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:52:29 2022] GET /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:52:30.298646 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-322a689e-1ba8-4980-b6c7-4b5a1277d9f4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:52:30.299332 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-322a689e-1ba8-4980-b6c7-4b5a1277d9f4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: dcccaffa-49b8-4d3f-b87d-c23204988c91] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:52:30.305400 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-322a689e-1ba8-4980-b6c7-4b5a1277d9f4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:30.305868 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-322a689e-1ba8-4980-b6c7-4b5a1277d9f4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:30.306289 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-322a689e-1ba8-4980-b6c7-4b5a1277d9f4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:30.306962 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-322a689e-1ba8-4980-b6c7-4b5a1277d9f4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:30.307400 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-322a689e-1ba8-4980-b6c7-4b5a1277d9f4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:30.307808 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-322a689e-1ba8-4980-b6c7-4b5a1277d9f4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:30.438008 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-322a689e-1ba8-4980-b6c7-4b5a1277d9f4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:52:30.445618 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-322a689e-1ba8-4980-b6c7-4b5a1277d9f4 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91" status: 200 len: 1367 microversion: 2.1 time: 0.151798 Sep 06 22:52:30.446174 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 492/975] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:52:30 2022] GET /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:52:31.469050 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fef40412-2b63-4378-9c60-604d32392fb5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:52:31.469672 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fef40412-2b63-4378-9c60-604d32392fb5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: dcccaffa-49b8-4d3f-b87d-c23204988c91] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:52:31.476170 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fef40412-2b63-4378-9c60-604d32392fb5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:31.476654 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fef40412-2b63-4378-9c60-604d32392fb5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:31.477124 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fef40412-2b63-4378-9c60-604d32392fb5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:31.478593 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fef40412-2b63-4378-9c60-604d32392fb5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:31.478847 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fef40412-2b63-4378-9c60-604d32392fb5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:31.479271 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fef40412-2b63-4378-9c60-604d32392fb5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:31.614906 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-fef40412-2b63-4378-9c60-604d32392fb5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:52:31.622750 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fef40412-2b63-4378-9c60-604d32392fb5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91" status: 200 len: 1367 microversion: 2.1 time: 0.157596 Sep 06 22:52:31.623420 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 484/976] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:52:31 2022] GET /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:52:32.645326 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-897aae8b-fb58-4778-ab93-402ebf8ba58e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:52:32.645932 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-897aae8b-fb58-4778-ab93-402ebf8ba58e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: dcccaffa-49b8-4d3f-b87d-c23204988c91] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:52:32.652884 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-897aae8b-fb58-4778-ab93-402ebf8ba58e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:32.653361 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-897aae8b-fb58-4778-ab93-402ebf8ba58e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:32.653790 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-897aae8b-fb58-4778-ab93-402ebf8ba58e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:32.654466 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-897aae8b-fb58-4778-ab93-402ebf8ba58e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:32.654910 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-897aae8b-fb58-4778-ab93-402ebf8ba58e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:32.655329 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-897aae8b-fb58-4778-ab93-402ebf8ba58e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:32.784101 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-897aae8b-fb58-4778-ab93-402ebf8ba58e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:52:32.792209 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-897aae8b-fb58-4778-ab93-402ebf8ba58e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91" status: 200 len: 1367 microversion: 2.1 time: 0.150748 Sep 06 22:52:32.792796 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 493/977] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:52:32 2022] GET /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:52:33.628259 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-ccaaf7e3-ecc2-4205-bb8c-1c8502a14a07 req-c98ac5db-ae0e-4113-8b84-845a0463e630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcccaffa-49b8-4d3f-b87d-c23204988c91", "name": "network-vif-plugged", "status": "completed", "tag": "e9c46522-6be6-4f46-b035-7c1bf2e2c3ff"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:52:33.638109 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-ccaaf7e3-ecc2-4205-bb8c-1c8502a14a07 req-c98ac5db-ae0e-4113-8b84-845a0463e630 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:33.638607 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-ccaaf7e3-ecc2-4205-bb8c-1c8502a14a07 req-c98ac5db-ae0e-4113-8b84-845a0463e630 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:33.639030 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-ccaaf7e3-ecc2-4205-bb8c-1c8502a14a07 req-c98ac5db-ae0e-4113-8b84-845a0463e630 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:33.649959 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-ccaaf7e3-ecc2-4205-bb8c-1c8502a14a07 req-c98ac5db-ae0e-4113-8b84-845a0463e630 service nova] Creating event network-vif-plugged:e9c46522-6be6-4f46-b035-7c1bf2e2c3ff for instance dcccaffa-49b8-4d3f-b87d-c23204988c91 on hv-cinder-85220 Sep 06 22:52:33.654944 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-ccaaf7e3-ecc2-4205-bb8c-1c8502a14a07 req-c98ac5db-ae0e-4113-8b84-845a0463e630 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030278 Sep 06 22:52:33.655720 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 485/978] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:52:33.815401 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d845dde9-4a80-4eec-9593-853908925995 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:52:33.815942 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-d845dde9-4a80-4eec-9593-853908925995 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: dcccaffa-49b8-4d3f-b87d-c23204988c91] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:52:33.822941 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d845dde9-4a80-4eec-9593-853908925995 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:33.823425 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d845dde9-4a80-4eec-9593-853908925995 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:33.823852 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d845dde9-4a80-4eec-9593-853908925995 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:33.824541 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d845dde9-4a80-4eec-9593-853908925995 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:33.825016 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d845dde9-4a80-4eec-9593-853908925995 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:33.825436 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d845dde9-4a80-4eec-9593-853908925995 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:33.964266 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-d845dde9-4a80-4eec-9593-853908925995 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:52:33.971726 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d845dde9-4a80-4eec-9593-853908925995 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91" status: 200 len: 1367 microversion: 2.1 time: 0.160382 Sep 06 22:52:33.972277 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 494/979] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:52:33 2022] GET /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:52:34.996334 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d736f1a7-307c-4c26-97ab-978da0ab199f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:52:34.997048 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d736f1a7-307c-4c26-97ab-978da0ab199f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: dcccaffa-49b8-4d3f-b87d-c23204988c91] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:52:35.003060 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d736f1a7-307c-4c26-97ab-978da0ab199f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:35.003514 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d736f1a7-307c-4c26-97ab-978da0ab199f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:35.003941 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d736f1a7-307c-4c26-97ab-978da0ab199f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:35.004613 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d736f1a7-307c-4c26-97ab-978da0ab199f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:35.005086 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d736f1a7-307c-4c26-97ab-978da0ab199f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:35.005509 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d736f1a7-307c-4c26-97ab-978da0ab199f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:35.139223 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d736f1a7-307c-4c26-97ab-978da0ab199f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:52:35.147022 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d736f1a7-307c-4c26-97ab-978da0ab199f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91" status: 200 len: 1557 microversion: 2.1 time: 0.156199 Sep 06 22:52:35.147621 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 486/980] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:52:34 2022] GET /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91 => generated 1557 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:52:35.173586 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-c73bcbb1-dac4-4f32-98e5-c5bea61a069f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:52:35.174123 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-c73bcbb1-dac4-4f32-98e5-c5bea61a069f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: dcccaffa-49b8-4d3f-b87d-c23204988c91] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:52:35.180359 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c73bcbb1-dac4-4f32-98e5-c5bea61a069f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:35.180859 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c73bcbb1-dac4-4f32-98e5-c5bea61a069f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:35.181853 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c73bcbb1-dac4-4f32-98e5-c5bea61a069f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:35.182702 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c73bcbb1-dac4-4f32-98e5-c5bea61a069f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:35.183144 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c73bcbb1-dac4-4f32-98e5-c5bea61a069f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:35.183552 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c73bcbb1-dac4-4f32-98e5-c5bea61a069f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:35.259050 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-c73bcbb1-dac4-4f32-98e5-c5bea61a069f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089216 Sep 06 22:52:35.259951 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 495/981] 10.222.0.39 () {58 vars in 1275 bytes} [Tue Sep 6 22:52:35 2022] GET /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:52:36.179644 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-2407737d-b5bd-4b5e-ba0f-4f599711b1dd req-b9fdd850-ebe1-4da3-b209-4052bdfaa4a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcccaffa-49b8-4d3f-b87d-c23204988c91", "tag": "e9c46522-6be6-4f46-b035-7c1bf2e2c3ff"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:52:36.184643 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=6 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:52:36.191289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-2407737d-b5bd-4b5e-ba0f-4f599711b1dd req-b9fdd850-ebe1-4da3-b209-4052bdfaa4a9 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:52:36.191289 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-2407737d-b5bd-4b5e-ba0f-4f599711b1dd req-b9fdd850-ebe1-4da3-b209-4052bdfaa4a9 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:52:36.191721 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-2407737d-b5bd-4b5e-ba0f-4f599711b1dd req-b9fdd850-ebe1-4da3-b209-4052bdfaa4a9 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:52:36.202587 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-2407737d-b5bd-4b5e-ba0f-4f599711b1dd req-b9fdd850-ebe1-4da3-b209-4052bdfaa4a9 service nova] Creating event network-changed:e9c46522-6be6-4f46-b035-7c1bf2e2c3ff for instance dcccaffa-49b8-4d3f-b87d-c23204988c91 on hv-cinder-85220 Sep 06 22:52:36.207312 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-2407737d-b5bd-4b5e-ba0f-4f599711b1dd req-b9fdd850-ebe1-4da3-b209-4052bdfaa4a9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031447 Sep 06 22:52:36.207917 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 487/982] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:53:02.499531 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a3892b42-8119-4653-8053-4275b0eeeb5b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:53:02.500087 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-a3892b42-8119-4653-8053-4275b0eeeb5b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 3a478b90-1417-492e-88c5-171aa3fa7eee] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:53:02.502032 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-736bec05-d1c7-4331-adf4-cbedb09a9341 req-c5ae1bc6-5d60-4ead-b07e-4f6169260756 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a478b90-1417-492e-88c5-171aa3fa7eee", "tag": "7108485c-a4f8-4d78-afb6-a3a836cff2d7"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:53:02.502443 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=2 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:53:02.503066 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=6 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:53:02.504516 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:53:02.505303 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:53:02.512265 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a3892b42-8119-4653-8053-4275b0eeeb5b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:02.513565 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a3892b42-8119-4653-8053-4275b0eeeb5b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:02.513565 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a3892b42-8119-4653-8053-4275b0eeeb5b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:02.514358 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a3892b42-8119-4653-8053-4275b0eeeb5b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:02.514954 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a3892b42-8119-4653-8053-4275b0eeeb5b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:02.515083 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:53:02.515845 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a3892b42-8119-4653-8053-4275b0eeeb5b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:02.515966 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:53:02.519245 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-736bec05-d1c7-4331-adf4-cbedb09a9341 req-c5ae1bc6-5d60-4ead-b07e-4f6169260756 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:02.519766 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-736bec05-d1c7-4331-adf4-cbedb09a9341 req-c5ae1bc6-5d60-4ead-b07e-4f6169260756 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:02.520567 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-736bec05-d1c7-4331-adf4-cbedb09a9341 req-c5ae1bc6-5d60-4ead-b07e-4f6169260756 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:02.536015 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-736bec05-d1c7-4331-adf4-cbedb09a9341 req-c5ae1bc6-5d60-4ead-b07e-4f6169260756 service nova] Creating event network-changed:7108485c-a4f8-4d78-afb6-a3a836cff2d7 for instance 3a478b90-1417-492e-88c5-171aa3fa7eee on hv-cinder-85220 Sep 06 22:53:02.542314 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-736bec05-d1c7-4331-adf4-cbedb09a9341 req-c5ae1bc6-5d60-4ead-b07e-4f6169260756 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043753 Sep 06 22:53:02.543121 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 488/983] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:53:02.550275 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-a3892b42-8119-4653-8053-4275b0eeeb5b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 3a478b90-1417-492e-88c5-171aa3fa7eee] Going to try to terminate instance {{(pid=127087) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 22:53:02.643937 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-a3892b42-8119-4653-8053-4275b0eeeb5b tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3a478b90-1417-492e-88c5-171aa3fa7eee" status: 204 len: 0 microversion: 2.1 time: 0.147967 Sep 06 22:53:02.647817 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 496/984] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Sep 6 22:53:02 2022] DELETE /compute/v2.1/servers/3a478b90-1417-492e-88c5-171aa3fa7eee => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 22:53:02.656581 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bbd4c0e8-0fdf-460d-876a-a86ee6fb011c tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:53:02.657720 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bbd4c0e8-0fdf-460d-876a-a86ee6fb011c tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 3a478b90-1417-492e-88c5-171aa3fa7eee] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:53:02.664266 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bbd4c0e8-0fdf-460d-876a-a86ee6fb011c tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:02.664782 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bbd4c0e8-0fdf-460d-876a-a86ee6fb011c tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:02.665235 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bbd4c0e8-0fdf-460d-876a-a86ee6fb011c tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:02.666444 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bbd4c0e8-0fdf-460d-876a-a86ee6fb011c tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:02.666903 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bbd4c0e8-0fdf-460d-876a-a86ee6fb011c tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:02.667458 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bbd4c0e8-0fdf-460d-876a-a86ee6fb011c tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:02.949286 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-bbd4c0e8-0fdf-460d-876a-a86ee6fb011c tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:53:02.956929 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bbd4c0e8-0fdf-460d-876a-a86ee6fb011c tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/3a478b90-1417-492e-88c5-171aa3fa7eee" status: 200 len: 1579 microversion: 2.1 time: 0.307620 Sep 06 22:53:02.957505 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 489/985] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:53:02 2022] GET /compute/v2.1/servers/3a478b90-1417-492e-88c5-171aa3fa7eee => generated 1579 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:53:03.980218 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-3709ca3c-edc6-4d45-8c1c-d9f2dc96f62f tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:53:03.981048 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-3709ca3c-edc6-4d45-8c1c-d9f2dc96f62f tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 3a478b90-1417-492e-88c5-171aa3fa7eee] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:53:03.987455 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3709ca3c-edc6-4d45-8c1c-d9f2dc96f62f tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:03.987941 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3709ca3c-edc6-4d45-8c1c-d9f2dc96f62f tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:03.988371 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3709ca3c-edc6-4d45-8c1c-d9f2dc96f62f tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:03.989096 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3709ca3c-edc6-4d45-8c1c-d9f2dc96f62f tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:03.989553 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3709ca3c-edc6-4d45-8c1c-d9f2dc96f62f tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:03.989971 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3709ca3c-edc6-4d45-8c1c-d9f2dc96f62f tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:04.192661 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3709ca3c-edc6-4d45-8c1c-d9f2dc96f62f tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:53:04.200493 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-3709ca3c-edc6-4d45-8c1c-d9f2dc96f62f tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/3a478b90-1417-492e-88c5-171aa3fa7eee" status: 200 len: 1579 microversion: 2.1 time: 0.224740 Sep 06 22:53:04.201090 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 497/986] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:53:03 2022] GET /compute/v2.1/servers/3a478b90-1417-492e-88c5-171aa3fa7eee => generated 1579 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:53:04.698942 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-b0f0f710-c00b-4b0d-8c31-f62349b62072 req-a6dd57b8-b54d-4b00-bc3f-f114f9624e52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a478b90-1417-492e-88c5-171aa3fa7eee", "name": "network-vif-deleted", "tag": "7108485c-a4f8-4d78-afb6-a3a836cff2d7"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:53:04.711239 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-b0f0f710-c00b-4b0d-8c31-f62349b62072 req-a6dd57b8-b54d-4b00-bc3f-f114f9624e52 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:04.711707 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-b0f0f710-c00b-4b0d-8c31-f62349b62072 req-a6dd57b8-b54d-4b00-bc3f-f114f9624e52 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:04.712128 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-b0f0f710-c00b-4b0d-8c31-f62349b62072 req-a6dd57b8-b54d-4b00-bc3f-f114f9624e52 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:04.724560 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-b0f0f710-c00b-4b0d-8c31-f62349b62072 req-a6dd57b8-b54d-4b00-bc3f-f114f9624e52 service nova] Creating event network-vif-deleted:7108485c-a4f8-4d78-afb6-a3a836cff2d7 for instance 3a478b90-1417-492e-88c5-171aa3fa7eee on hv-cinder-85220 Sep 06 22:53:04.730870 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-b0f0f710-c00b-4b0d-8c31-f62349b62072 req-a6dd57b8-b54d-4b00-bc3f-f114f9624e52 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036753 Sep 06 22:53:04.731474 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 490/987] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:53:05.223828 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-acb9997d-2d80-41bf-b22c-1f0a95037683 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:53:05.224377 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-acb9997d-2d80-41bf-b22c-1f0a95037683 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 3a478b90-1417-492e-88c5-171aa3fa7eee] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:53:05.231503 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-acb9997d-2d80-41bf-b22c-1f0a95037683 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:05.232512 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-acb9997d-2d80-41bf-b22c-1f0a95037683 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:05.232975 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-acb9997d-2d80-41bf-b22c-1f0a95037683 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:05.233668 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-acb9997d-2d80-41bf-b22c-1f0a95037683 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:05.234122 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-acb9997d-2d80-41bf-b22c-1f0a95037683 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:05.234515 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-acb9997d-2d80-41bf-b22c-1f0a95037683 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:05.265761 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-acb9997d-2d80-41bf-b22c-1f0a95037683 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:05.266571 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-acb9997d-2d80-41bf-b22c-1f0a95037683 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:05.267317 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-acb9997d-2d80-41bf-b22c-1f0a95037683 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:05.268532 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.objects.instance [None req-acb9997d-2d80-41bf-b22c-1f0a95037683 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lazy-loading 'fault' on Instance uuid 3a478b90-1417-492e-88c5-171aa3fa7eee {{(pid=127087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 22:53:05.314130 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-acb9997d-2d80-41bf-b22c-1f0a95037683 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:53:05.321706 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-acb9997d-2d80-41bf-b22c-1f0a95037683 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/3a478b90-1417-492e-88c5-171aa3fa7eee" status: 200 len: 1230 microversion: 2.1 time: 0.101835 Sep 06 22:53:05.322648 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 498/988] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:53:05 2022] GET /compute/v2.1/servers/3a478b90-1417-492e-88c5-171aa3fa7eee => generated 1230 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:53:06.345715 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6023c439-3db3-4d2d-aafe-1b676fbf7459 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:53:06.346408 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-6023c439-3db3-4d2d-aafe-1b676fbf7459 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 3a478b90-1417-492e-88c5-171aa3fa7eee] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:53:06.352522 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6023c439-3db3-4d2d-aafe-1b676fbf7459 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:06.353032 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6023c439-3db3-4d2d-aafe-1b676fbf7459 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:06.354540 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6023c439-3db3-4d2d-aafe-1b676fbf7459 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:06.355243 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6023c439-3db3-4d2d-aafe-1b676fbf7459 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:06.355697 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6023c439-3db3-4d2d-aafe-1b676fbf7459 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:06.356120 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-6023c439-3db3-4d2d-aafe-1b676fbf7459 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:06.370413 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-6023c439-3db3-4d2d-aafe-1b676fbf7459 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] HTTP exception thrown: Instance 3a478b90-1417-492e-88c5-171aa3fa7eee could not be found. Sep 06 22:53:06.372037 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6023c439-3db3-4d2d-aafe-1b676fbf7459 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Request method failure captured: Sep 06 22:53:06.372037 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/3a478b90-1417-492e-88c5-171aa3fa7eee HTTP/1.1 Sep 06 22:53:06.372037 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept: application/json Sep 06 22:53:06.372037 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Sep 06 22:53:06.372037 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Connection: close Sep 06 22:53:06.372037 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Length: 0 Sep 06 22:53:06.372037 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Type: application/json Sep 06 22:53:06.372037 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Host: 10.222.0.39 Sep 06 22:53:06.372037 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Sep 06 22:53:06.372037 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Sep 06 22:53:06.372037 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjF82Ap10uAwga9UaNgI0YSLtD2GAcJ-KBqO8hmQ1SgLUyG-QbzSEQhw0c9i1QLdiHOcbUzu0-LnWV2Xu71fhrgHEbw2fmStUxQtj1ErYFz8ALnAkDeHD9G5TpqDQXZqC_5ma1z-PiT19KGywR8DmLNKlr6dAyW2nNCaDvBk-VdgdKHQk Sep 06 22:53:06.372037 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Sep 06 22:53:06.372037 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Sep 06 22:53:06.372037 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Sep 06 22:53:06.372037 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Sep 06 22:53:06.372037 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Sep 06 22:53:06.372037 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Sep 06 22:53:06.372037 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Id: cc47231427ec4337833eb5d733b211bc Sep 06 22:53:06.372037 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-TestVolumeBootPattern-911177040 Sep 06 22:53:06.372037 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Role: reader,member Sep 06 22:53:06.372037 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Sep 06 22:53:06.373710 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cc47231427ec4337833eb5d733b211bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cc47231427ec4337833eb5d733b211bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc47231427ec4337833eb5d733b211bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc47231427ec4337833eb5d733b211bc"}]}] Sep 06 22:53:06.373710 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-TestVolumeBootPattern-911177040 Sep 06 22:53:06.373710 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Id: cc47231427ec4337833eb5d733b211bc Sep 06 22:53:06.373710 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-TestVolumeBootPattern-911177040 Sep 06 22:53:06.373710 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User: tempest-TestVolumeBootPattern-911177040-project Sep 06 22:53:06.373710 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Sep 06 22:53:06.373710 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Sep 06 22:53:06.373710 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Id: 29018ec15cc147d3919d9047569a4c68 Sep 06 22:53:06.373710 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-TestVolumeBootPattern-911177040-project Sep 06 22:53:06.373710 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: method: > Sep 06 22:53:06.373710 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: exception: Instance 3a478b90-1417-492e-88c5-171aa3fa7eee could not be found. Sep 06 22:53:06.373710 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: action_args: {'id': '3a478b90-1417-492e-88c5-171aa3fa7eee'} Sep 06 22:53:06.374634 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:53:06.374634 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:53:06.374634 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:53:06.374634 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:53:06.374634 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:53:06.374634 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:53:06.374634 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:53:06.374634 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:53:06.374634 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:53:06.374634 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:53:06.374634 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a478b90-1417-492e-88c5-171aa3fa7eee could not be found. Sep 06 22:53:06.374634 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:53:06.374634 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:53:06.374634 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:53:06.374634 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:53:06.374634 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:53:06.374634 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:53:06.374634 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:53:06.374634 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:53:06.374634 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:53:06.376205 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:53:06.376205 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 22:53:06.376205 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 22:53:06.376205 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:53:06.376205 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:53:06.376205 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:53:06.376205 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:53:06.376205 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a478b90-1417-492e-88c5-171aa3fa7eee could not be found. Sep 06 22:53:06.376205 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:53:06.376205 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:53:06.376205 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:53:06.376205 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:53:06.376205 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:53:06.376205 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:53:06.376205 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:53:06.376205 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:53:06.376205 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a478b90-1417-492e-88c5-171aa3fa7eee could not be found. Sep 06 22:53:06.376205 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:53:06.377656 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-6023c439-3db3-4d2d-aafe-1b676fbf7459 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Returning 404 to user: Instance 3a478b90-1417-492e-88c5-171aa3fa7eee could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:53:06.377656 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-6023c439-3db3-4d2d-aafe-1b676fbf7459 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/3a478b90-1417-492e-88c5-171aa3fa7eee" status: 404 len: 111 microversion: 2.1 time: 0.032497 Sep 06 22:53:06.377656 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 491/989] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:53:06 2022] GET /compute/v2.1/servers/3a478b90-1417-492e-88c5-171aa3fa7eee => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 22:53:09.438056 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-61548683-bfe9-445c-9135-b96835da133c tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:53:09.438617 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-61548683-bfe9-445c-9135-b96835da133c tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 5acd0d35-4bad-4c55-853d-767fec050879] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:53:09.440840 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-d3dd11d9-e95d-40a4-b047-4c1155333a82 req-176bbcee-b726-4764-b539-35ad0e025f22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5acd0d35-4bad-4c55-853d-767fec050879", "tag": "5283334a-d586-42df-ac4b-7eae8c83bfd3"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:53:09.445137 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-61548683-bfe9-445c-9135-b96835da133c tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:09.445611 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-61548683-bfe9-445c-9135-b96835da133c tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:09.446263 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-61548683-bfe9-445c-9135-b96835da133c tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:09.447365 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-61548683-bfe9-445c-9135-b96835da133c tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:09.447811 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-61548683-bfe9-445c-9135-b96835da133c tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:09.448432 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-61548683-bfe9-445c-9135-b96835da133c tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:09.451031 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-d3dd11d9-e95d-40a4-b047-4c1155333a82 req-176bbcee-b726-4764-b539-35ad0e025f22 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:09.451501 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-d3dd11d9-e95d-40a4-b047-4c1155333a82 req-176bbcee-b726-4764-b539-35ad0e025f22 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:09.451918 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-d3dd11d9-e95d-40a4-b047-4c1155333a82 req-176bbcee-b726-4764-b539-35ad0e025f22 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:09.463232 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-d3dd11d9-e95d-40a4-b047-4c1155333a82 req-176bbcee-b726-4764-b539-35ad0e025f22 service nova] Creating event network-changed:5283334a-d586-42df-ac4b-7eae8c83bfd3 for instance 5acd0d35-4bad-4c55-853d-767fec050879 on hv-cinder-85220 Sep 06 22:53:09.468515 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-d3dd11d9-e95d-40a4-b047-4c1155333a82 req-176bbcee-b726-4764-b539-35ad0e025f22 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032356 Sep 06 22:53:09.469501 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 492/990] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:53:09.475518 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-61548683-bfe9-445c-9135-b96835da133c tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 5acd0d35-4bad-4c55-853d-767fec050879] Going to try to terminate instance {{(pid=127087) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 22:53:09.570149 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-61548683-bfe9-445c-9135-b96835da133c tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879" status: 204 len: 0 microversion: 2.1 time: 0.134692 Sep 06 22:53:09.575940 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 499/991] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Sep 6 22:53:09 2022] DELETE /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 22:53:09.580638 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-f753893c-a0b2-45d8-bfd8-5c8c75eaa893 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:53:09.581365 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-f753893c-a0b2-45d8-bfd8-5c8c75eaa893 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 5acd0d35-4bad-4c55-853d-767fec050879] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:53:09.587664 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f753893c-a0b2-45d8-bfd8-5c8c75eaa893 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:09.588142 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f753893c-a0b2-45d8-bfd8-5c8c75eaa893 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:09.588572 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f753893c-a0b2-45d8-bfd8-5c8c75eaa893 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:09.589281 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f753893c-a0b2-45d8-bfd8-5c8c75eaa893 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:09.589725 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f753893c-a0b2-45d8-bfd8-5c8c75eaa893 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:09.590142 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-f753893c-a0b2-45d8-bfd8-5c8c75eaa893 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:09.744894 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-f753893c-a0b2-45d8-bfd8-5c8c75eaa893 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:53:09.752800 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-f753893c-a0b2-45d8-bfd8-5c8c75eaa893 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879" status: 200 len: 1578 microversion: 2.1 time: 0.176225 Sep 06 22:53:09.753380 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 493/992] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:53:09 2022] GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879 => generated 1578 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:53:10.777909 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-adefc82d-de5c-49fb-a247-5cd17b1d9003 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:53:10.778596 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-adefc82d-de5c-49fb-a247-5cd17b1d9003 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 5acd0d35-4bad-4c55-853d-767fec050879] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:53:10.785285 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-adefc82d-de5c-49fb-a247-5cd17b1d9003 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:10.785755 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-adefc82d-de5c-49fb-a247-5cd17b1d9003 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:10.786176 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-adefc82d-de5c-49fb-a247-5cd17b1d9003 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:10.786844 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-adefc82d-de5c-49fb-a247-5cd17b1d9003 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:10.787287 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-adefc82d-de5c-49fb-a247-5cd17b1d9003 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:10.787694 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-adefc82d-de5c-49fb-a247-5cd17b1d9003 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:11.337041 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-adefc82d-de5c-49fb-a247-5cd17b1d9003 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:53:11.345451 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-adefc82d-de5c-49fb-a247-5cd17b1d9003 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879" status: 200 len: 1578 microversion: 2.1 time: 0.572258 Sep 06 22:53:11.346220 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 500/993] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:53:10 2022] GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879 => generated 1578 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:53:11.842244 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-9131bbec-8aaf-4954-8bf2-b41ba7284e4a req-2ff48ac1-6238-4c3c-9be2-59b6586fbdf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5acd0d35-4bad-4c55-853d-767fec050879", "name": "network-vif-deleted", "tag": "5283334a-d586-42df-ac4b-7eae8c83bfd3"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:53:11.852467 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-9131bbec-8aaf-4954-8bf2-b41ba7284e4a req-2ff48ac1-6238-4c3c-9be2-59b6586fbdf4 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:11.853603 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-9131bbec-8aaf-4954-8bf2-b41ba7284e4a req-2ff48ac1-6238-4c3c-9be2-59b6586fbdf4 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:11.854080 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-9131bbec-8aaf-4954-8bf2-b41ba7284e4a req-2ff48ac1-6238-4c3c-9be2-59b6586fbdf4 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:11.867395 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-9131bbec-8aaf-4954-8bf2-b41ba7284e4a req-2ff48ac1-6238-4c3c-9be2-59b6586fbdf4 service nova] Creating event network-vif-deleted:5283334a-d586-42df-ac4b-7eae8c83bfd3 for instance 5acd0d35-4bad-4c55-853d-767fec050879 on hv-cinder-85220 Sep 06 22:53:11.872153 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-9131bbec-8aaf-4954-8bf2-b41ba7284e4a req-2ff48ac1-6238-4c3c-9be2-59b6586fbdf4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033635 Sep 06 22:53:11.872745 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 494/994] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:53:12.129524 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-5ae2c654-cd19-4d0b-b38b-c5e5548c4c80 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:53:12.130101 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-5ae2c654-cd19-4d0b-b38b-c5e5548c4c80 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: dcccaffa-49b8-4d3f-b87d-c23204988c91] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:53:12.137510 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5ae2c654-cd19-4d0b-b38b-c5e5548c4c80 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:12.138334 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5ae2c654-cd19-4d0b-b38b-c5e5548c4c80 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:12.139078 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5ae2c654-cd19-4d0b-b38b-c5e5548c4c80 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:12.139952 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5ae2c654-cd19-4d0b-b38b-c5e5548c4c80 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:12.141192 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5ae2c654-cd19-4d0b-b38b-c5e5548c4c80 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:12.141611 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5ae2c654-cd19-4d0b-b38b-c5e5548c4c80 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:12.167976 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-5ae2c654-cd19-4d0b-b38b-c5e5548c4c80 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91/ips" status: 200 len: 149 microversion: 2.1 time: 0.042299 Sep 06 22:53:12.168556 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 501/995] 10.222.0.39 () {58 vars in 1248 bytes} [Tue Sep 6 22:53:12 2022] GET /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:53:12.370339 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b7f9619c-73aa-4878-9393-4502ad21b42f tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:53:12.371031 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b7f9619c-73aa-4878-9393-4502ad21b42f tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 5acd0d35-4bad-4c55-853d-767fec050879] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:53:12.377985 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b7f9619c-73aa-4878-9393-4502ad21b42f tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:12.378789 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b7f9619c-73aa-4878-9393-4502ad21b42f tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:12.379222 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b7f9619c-73aa-4878-9393-4502ad21b42f tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:12.379911 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b7f9619c-73aa-4878-9393-4502ad21b42f tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:12.380353 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b7f9619c-73aa-4878-9393-4502ad21b42f tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:12.381692 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b7f9619c-73aa-4878-9393-4502ad21b42f tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:12.419002 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b7f9619c-73aa-4878-9393-4502ad21b42f tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:12.419609 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b7f9619c-73aa-4878-9393-4502ad21b42f tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:12.420138 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b7f9619c-73aa-4878-9393-4502ad21b42f tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:12.420692 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-b7f9619c-73aa-4878-9393-4502ad21b42f tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lazy-loading 'fault' on Instance uuid 5acd0d35-4bad-4c55-853d-767fec050879 {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 22:53:12.472852 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b7f9619c-73aa-4878-9393-4502ad21b42f tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29018ec15cc147d3919d9047569a4c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc47231427ec4337833eb5d733b211bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:53:12.482998 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b7f9619c-73aa-4878-9393-4502ad21b42f tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879" status: 200 len: 1230 microversion: 2.1 time: 0.117340 Sep 06 22:53:12.494463 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 495/996] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:53:12 2022] GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879 => generated 1230 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:53:13.508597 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-de30a14f-d76f-4e22-97ca-9e436e1f03b7 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:53:13.509178 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-de30a14f-d76f-4e22-97ca-9e436e1f03b7 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 5acd0d35-4bad-4c55-853d-767fec050879] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:53:13.515871 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-de30a14f-d76f-4e22-97ca-9e436e1f03b7 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:13.516336 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-de30a14f-d76f-4e22-97ca-9e436e1f03b7 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:13.516785 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-de30a14f-d76f-4e22-97ca-9e436e1f03b7 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:13.517459 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-de30a14f-d76f-4e22-97ca-9e436e1f03b7 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:13.517897 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-de30a14f-d76f-4e22-97ca-9e436e1f03b7 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:13.518303 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-de30a14f-d76f-4e22-97ca-9e436e1f03b7 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:13.534847 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-de30a14f-d76f-4e22-97ca-9e436e1f03b7 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] HTTP exception thrown: Instance 5acd0d35-4bad-4c55-853d-767fec050879 could not be found. Sep 06 22:53:13.536472 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-de30a14f-d76f-4e22-97ca-9e436e1f03b7 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Request method failure captured: Sep 06 22:53:13.536472 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: request: GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879 HTTP/1.1 Sep 06 22:53:13.536472 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept: application/json Sep 06 22:53:13.536472 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Sep 06 22:53:13.536472 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Connection: close Sep 06 22:53:13.536472 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Length: 0 Sep 06 22:53:13.536472 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Type: application/json Sep 06 22:53:13.536472 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Host: 10.222.0.39 Sep 06 22:53:13.536472 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Sep 06 22:53:13.536472 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.12 Sep 06 22:53:13.536472 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABjF82Ap10uAwga9UaNgI0YSLtD2GAcJ-KBqO8hmQ1SgLUyG-QbzSEQhw0c9i1QLdiHOcbUzu0-LnWV2Xu71fhrgHEbw2fmStUxQtj1ErYFz8ALnAkDeHD9G5TpqDQXZqC_5ma1z-PiT19KGywR8DmLNKlr6dAyW2nNCaDvBk-VdgdKHQk Sep 06 22:53:13.536472 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Sep 06 22:53:13.536472 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Sep 06 22:53:13.536472 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Sep 06 22:53:13.536472 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Sep 06 22:53:13.536472 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Sep 06 22:53:13.536472 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Sep 06 22:53:13.536472 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Id: cc47231427ec4337833eb5d733b211bc Sep 06 22:53:13.536472 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-TestVolumeBootPattern-911177040 Sep 06 22:53:13.536472 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Role: reader,member Sep 06 22:53:13.536472 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Sep 06 22:53:13.538154 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cc47231427ec4337833eb5d733b211bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cc47231427ec4337833eb5d733b211bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc47231427ec4337833eb5d733b211bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc47231427ec4337833eb5d733b211bc"}]}] Sep 06 22:53:13.538154 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-TestVolumeBootPattern-911177040 Sep 06 22:53:13.538154 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Id: cc47231427ec4337833eb5d733b211bc Sep 06 22:53:13.538154 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-TestVolumeBootPattern-911177040 Sep 06 22:53:13.538154 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User: tempest-TestVolumeBootPattern-911177040-project Sep 06 22:53:13.538154 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Sep 06 22:53:13.538154 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Sep 06 22:53:13.538154 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Id: 29018ec15cc147d3919d9047569a4c68 Sep 06 22:53:13.538154 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-TestVolumeBootPattern-911177040-project Sep 06 22:53:13.538154 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: method: > Sep 06 22:53:13.538154 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: exception: Instance 5acd0d35-4bad-4c55-853d-767fec050879 could not be found. Sep 06 22:53:13.538154 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: action_args: {'id': '5acd0d35-4bad-4c55-853d-767fec050879'} Sep 06 22:53:13.539070 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:53:13.539070 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:53:13.539070 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:53:13.539070 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:53:13.539070 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:53:13.539070 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:53:13.539070 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:53:13.539070 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:53:13.539070 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:53:13.539070 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:53:13.539070 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5acd0d35-4bad-4c55-853d-767fec050879 could not be found. Sep 06 22:53:13.539070 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:53:13.539070 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:53:13.539070 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:53:13.539070 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:53:13.539070 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:53:13.539070 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:53:13.539070 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:53:13.539070 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:53:13.539070 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:53:13.540280 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:53:13.540280 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 22:53:13.540280 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 22:53:13.540280 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:53:13.540280 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:53:13.540280 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:53:13.540280 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:53:13.540280 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5acd0d35-4bad-4c55-853d-767fec050879 could not be found. Sep 06 22:53:13.540280 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:53:13.540280 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:53:13.540280 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:53:13.540280 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:53:13.540280 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:53:13.540280 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:53:13.540280 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:53:13.540280 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:53:13.540280 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5acd0d35-4bad-4c55-853d-767fec050879 could not be found. Sep 06 22:53:13.540280 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:53:13.541446 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-de30a14f-d76f-4e22-97ca-9e436e1f03b7 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Returning 404 to user: Instance 5acd0d35-4bad-4c55-853d-767fec050879 could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:53:13.541446 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-de30a14f-d76f-4e22-97ca-9e436e1f03b7 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879" status: 404 len: 111 microversion: 2.1 time: 0.033287 Sep 06 22:53:13.541446 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 502/997] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:53:13 2022] GET /compute/v2.1/servers/5acd0d35-4bad-4c55-853d-767fec050879 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 22:53:13.594304 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b0eed80d-3333-493e-a38e-9a81ac2d98eb tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e7dd3d6-5bb1-4680-aa9d-8d363b45091d"}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:53:13.596741 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b0eed80d-3333-493e-a38e-9a81ac2d98eb tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: dcccaffa-49b8-4d3f-b87d-c23204988c91] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:53:13.603609 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b0eed80d-3333-493e-a38e-9a81ac2d98eb tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:13.604091 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b0eed80d-3333-493e-a38e-9a81ac2d98eb tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:13.604520 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b0eed80d-3333-493e-a38e-9a81ac2d98eb tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:13.606177 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b0eed80d-3333-493e-a38e-9a81ac2d98eb tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:13.606624 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b0eed80d-3333-493e-a38e-9a81ac2d98eb tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:13.607039 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b0eed80d-3333-493e-a38e-9a81ac2d98eb tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:13.851056 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b0eed80d-3333-493e-a38e-9a81ac2d98eb tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "POST /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260507 Sep 06 22:53:13.858005 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 496/998] 10.222.0.39 () {60 vars in 1323 bytes} [Tue Sep 6 22:53:13 2022] POST /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:53:14.226046 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-226ab622-4c2d-455c-991a-6f3533bee383 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:53:14.226608 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-226ab622-4c2d-455c-991a-6f3533bee383 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:53:14.232721 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-226ab622-4c2d-455c-991a-6f3533bee383 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:14.233216 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-226ab622-4c2d-455c-991a-6f3533bee383 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:14.233642 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-226ab622-4c2d-455c-991a-6f3533bee383 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:14.234321 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-226ab622-4c2d-455c-991a-6f3533bee383 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:14.234763 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-226ab622-4c2d-455c-991a-6f3533bee383 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:14.235176 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-226ab622-4c2d-455c-991a-6f3533bee383 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:14.248916 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-226ab622-4c2d-455c-991a-6f3533bee383 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] HTTP exception thrown: Instance 7930b2ec-9579-46df-a554-d9b9ba019126 could not be found. Sep 06 22:53:14.250488 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-226ab622-4c2d-455c-991a-6f3533bee383 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Request method failure captured: Sep 06 22:53:14.250488 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: request: DELETE /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 HTTP/1.1 Sep 06 22:53:14.250488 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept: application/json Sep 06 22:53:14.250488 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Sep 06 22:53:14.250488 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Connection: close Sep 06 22:53:14.250488 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Length: 0 Sep 06 22:53:14.250488 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Type: application/json Sep 06 22:53:14.250488 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Host: 10.222.0.39 Sep 06 22:53:14.250488 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Sep 06 22:53:14.250488 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.12 Sep 06 22:53:14.250488 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABjF82Ap10uAwga9UaNgI0YSLtD2GAcJ-KBqO8hmQ1SgLUyG-QbzSEQhw0c9i1QLdiHOcbUzu0-LnWV2Xu71fhrgHEbw2fmStUxQtj1ErYFz8ALnAkDeHD9G5TpqDQXZqC_5ma1z-PiT19KGywR8DmLNKlr6dAyW2nNCaDvBk-VdgdKHQk Sep 06 22:53:14.250488 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Sep 06 22:53:14.250488 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Sep 06 22:53:14.250488 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Sep 06 22:53:14.250488 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Sep 06 22:53:14.250488 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Sep 06 22:53:14.250488 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Sep 06 22:53:14.250488 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Id: cc47231427ec4337833eb5d733b211bc Sep 06 22:53:14.250488 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-TestVolumeBootPattern-911177040 Sep 06 22:53:14.250488 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Role: reader,member Sep 06 22:53:14.250488 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Sep 06 22:53:14.252087 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cc47231427ec4337833eb5d733b211bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cc47231427ec4337833eb5d733b211bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc47231427ec4337833eb5d733b211bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc47231427ec4337833eb5d733b211bc"}]}] Sep 06 22:53:14.252087 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-TestVolumeBootPattern-911177040 Sep 06 22:53:14.252087 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Id: cc47231427ec4337833eb5d733b211bc Sep 06 22:53:14.252087 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-TestVolumeBootPattern-911177040 Sep 06 22:53:14.252087 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User: tempest-TestVolumeBootPattern-911177040-project Sep 06 22:53:14.252087 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Sep 06 22:53:14.252087 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Sep 06 22:53:14.252087 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Id: 29018ec15cc147d3919d9047569a4c68 Sep 06 22:53:14.252087 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-TestVolumeBootPattern-911177040-project Sep 06 22:53:14.252087 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: method: > Sep 06 22:53:14.252087 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: exception: Instance 7930b2ec-9579-46df-a554-d9b9ba019126 could not be found. Sep 06 22:53:14.252087 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: action_args: {'id': '7930b2ec-9579-46df-a554-d9b9ba019126'} Sep 06 22:53:14.253544 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:53:14.253544 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:53:14.253544 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:53:14.253544 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:53:14.253544 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:53:14.253544 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:53:14.253544 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:53:14.253544 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:53:14.253544 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:53:14.253544 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:53:14.253544 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7930b2ec-9579-46df-a554-d9b9ba019126 could not be found. Sep 06 22:53:14.253544 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:53:14.253544 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:53:14.253544 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:53:14.253544 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:53:14.253544 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:53:14.253544 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:53:14.253544 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:53:14.253544 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:53:14.253544 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:53:14.255222 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:53:14.255222 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 22:53:14.255222 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 22:53:14.255222 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 22:53:14.255222 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 22:53:14.255222 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:53:14.255222 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:53:14.255222 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:53:14.255222 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:53:14.255222 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7930b2ec-9579-46df-a554-d9b9ba019126 could not be found. Sep 06 22:53:14.255222 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:53:14.255222 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:53:14.255222 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:53:14.255222 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:53:14.255222 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:53:14.255222 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:53:14.255222 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:53:14.255222 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:53:14.255222 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7930b2ec-9579-46df-a554-d9b9ba019126 could not be found. Sep 06 22:53:14.255222 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:53:14.256944 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-226ab622-4c2d-455c-991a-6f3533bee383 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Returning 404 to user: Instance 7930b2ec-9579-46df-a554-d9b9ba019126 could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:53:14.256944 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-226ab622-4c2d-455c-991a-6f3533bee383 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126" status: 404 len: 111 microversion: 2.1 time: 0.029750 Sep 06 22:53:14.256944 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 503/999] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Sep 6 22:53:14 2022] DELETE /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 22:53:14.263615 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e5e930b4-c232-42fc-bd34-50fac928a459 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:53:14.264321 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e5e930b4-c232-42fc-bd34-50fac928a459 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] [instance: 7930b2ec-9579-46df-a554-d9b9ba019126] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:53:14.271207 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e5e930b4-c232-42fc-bd34-50fac928a459 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:14.271697 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e5e930b4-c232-42fc-bd34-50fac928a459 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:14.272125 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e5e930b4-c232-42fc-bd34-50fac928a459 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:14.272906 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e5e930b4-c232-42fc-bd34-50fac928a459 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:14.273364 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e5e930b4-c232-42fc-bd34-50fac928a459 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:14.273894 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e5e930b4-c232-42fc-bd34-50fac928a459 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:14.287982 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-e5e930b4-c232-42fc-bd34-50fac928a459 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] HTTP exception thrown: Instance 7930b2ec-9579-46df-a554-d9b9ba019126 could not be found. Sep 06 22:53:14.289588 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e5e930b4-c232-42fc-bd34-50fac928a459 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Request method failure captured: Sep 06 22:53:14.289588 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 HTTP/1.1 Sep 06 22:53:14.289588 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept: application/json Sep 06 22:53:14.289588 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Sep 06 22:53:14.289588 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Connection: close Sep 06 22:53:14.289588 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Length: 0 Sep 06 22:53:14.289588 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Type: application/json Sep 06 22:53:14.289588 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Host: 10.222.0.39 Sep 06 22:53:14.289588 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Sep 06 22:53:14.289588 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Sep 06 22:53:14.289588 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjF82Ap10uAwga9UaNgI0YSLtD2GAcJ-KBqO8hmQ1SgLUyG-QbzSEQhw0c9i1QLdiHOcbUzu0-LnWV2Xu71fhrgHEbw2fmStUxQtj1ErYFz8ALnAkDeHD9G5TpqDQXZqC_5ma1z-PiT19KGywR8DmLNKlr6dAyW2nNCaDvBk-VdgdKHQk Sep 06 22:53:14.289588 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Sep 06 22:53:14.289588 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Sep 06 22:53:14.289588 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Sep 06 22:53:14.289588 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Sep 06 22:53:14.289588 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Sep 06 22:53:14.289588 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Sep 06 22:53:14.289588 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Id: cc47231427ec4337833eb5d733b211bc Sep 06 22:53:14.289588 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-TestVolumeBootPattern-911177040 Sep 06 22:53:14.289588 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Role: reader,member Sep 06 22:53:14.289588 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Sep 06 22:53:14.291227 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cc47231427ec4337833eb5d733b211bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cc47231427ec4337833eb5d733b211bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc47231427ec4337833eb5d733b211bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cc47231427ec4337833eb5d733b211bc"}]}] Sep 06 22:53:14.291227 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-TestVolumeBootPattern-911177040 Sep 06 22:53:14.291227 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Id: cc47231427ec4337833eb5d733b211bc Sep 06 22:53:14.291227 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-TestVolumeBootPattern-911177040 Sep 06 22:53:14.291227 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User: tempest-TestVolumeBootPattern-911177040-project Sep 06 22:53:14.291227 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Sep 06 22:53:14.291227 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Sep 06 22:53:14.291227 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Id: 29018ec15cc147d3919d9047569a4c68 Sep 06 22:53:14.291227 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-TestVolumeBootPattern-911177040-project Sep 06 22:53:14.291227 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: method: > Sep 06 22:53:14.291227 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: exception: Instance 7930b2ec-9579-46df-a554-d9b9ba019126 could not be found. Sep 06 22:53:14.291227 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: action_args: {'id': '7930b2ec-9579-46df-a554-d9b9ba019126'} Sep 06 22:53:14.295484 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:53:14.295484 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:53:14.295484 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:53:14.295484 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:53:14.295484 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:53:14.295484 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:53:14.295484 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:53:14.295484 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:53:14.295484 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:53:14.295484 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:53:14.295484 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7930b2ec-9579-46df-a554-d9b9ba019126 could not be found. Sep 06 22:53:14.295484 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:53:14.295484 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:53:14.295484 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:53:14.295484 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:53:14.295484 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:53:14.295484 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:53:14.295484 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:53:14.295484 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:53:14.295484 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:53:14.297011 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:53:14.297011 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 22:53:14.297011 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 22:53:14.297011 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:53:14.297011 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:53:14.297011 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:53:14.297011 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:53:14.297011 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7930b2ec-9579-46df-a554-d9b9ba019126 could not be found. Sep 06 22:53:14.297011 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:53:14.297011 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:53:14.297011 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:53:14.297011 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:53:14.297011 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:53:14.297011 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:53:14.297011 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:53:14.297011 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:53:14.297011 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7930b2ec-9579-46df-a554-d9b9ba019126 could not be found. Sep 06 22:53:14.297011 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:53:14.298593 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e5e930b4-c232-42fc-bd34-50fac928a459 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Returning 404 to user: Instance 7930b2ec-9579-46df-a554-d9b9ba019126 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:53:14.298593 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e5e930b4-c232-42fc-bd34-50fac928a459 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126" status: 404 len: 111 microversion: 2.1 time: 0.033494 Sep 06 22:53:14.298593 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 497/1000] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:53:14 2022] GET /compute/v2.1/servers/7930b2ec-9579-46df-a554-d9b9ba019126 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 22:53:15.582377 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-4e729b85-3def-4cdf-a2ff-85d849e7b448 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] Calling method '.version_select at 0x7f9c4f82e3a0>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:53:15.604039 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-4e729b85-3def-4cdf-a2ff-85d849e7b448 tempest-TestVolumeBootPattern-911177040 tempest-TestVolumeBootPattern-911177040-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1102918603" status: 202 len: 0 microversion: 2.1 time: 0.025797 Sep 06 22:53:15.604891 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 504/1001] 10.222.0.39 () {58 vars in 1263 bytes} [Tue Sep 6 22:53:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1102918603 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 22:53:20.366937 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-15042d77-523c-4ce4-9e1a-7df7addf0c0e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e7dd3d6-5bb1-4680-aa9d-8d363b45091d"}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:53:20.370291 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-15042d77-523c-4ce4-9e1a-7df7addf0c0e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: dcccaffa-49b8-4d3f-b87d-c23204988c91] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:53:20.377497 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-15042d77-523c-4ce4-9e1a-7df7addf0c0e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:20.378249 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-15042d77-523c-4ce4-9e1a-7df7addf0c0e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:20.378897 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-15042d77-523c-4ce4-9e1a-7df7addf0c0e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:20.379786 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-15042d77-523c-4ce4-9e1a-7df7addf0c0e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:20.380544 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-15042d77-523c-4ce4-9e1a-7df7addf0c0e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:20.381277 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-15042d77-523c-4ce4-9e1a-7df7addf0c0e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:20.473590 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-15042d77-523c-4ce4-9e1a-7df7addf0c0e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] HTTP exception thrown: Invalid volume: volume 3e7dd3d6-5bb1-4680-aa9d-8d363b45091d is already attached to instances: dcccaffa-49b8-4d3f-b87d-c23204988c91 Sep 06 22:53:20.475627 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-15042d77-523c-4ce4-9e1a-7df7addf0c0e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Request method failure captured: Sep 06 22:53:20.475627 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: request: POST /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91/os-volume_attachments HTTP/1.1 Sep 06 22:53:20.475627 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept: application/json Sep 06 22:53:20.475627 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Sep 06 22:53:20.475627 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Connection: close Sep 06 22:53:20.475627 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Length: 74 Sep 06 22:53:20.475627 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Type: application/json Sep 06 22:53:20.475627 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Host: 10.222.0.39 Sep 06 22:53:20.475627 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Sep 06 22:53:20.475627 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Sep 06 22:53:20.475627 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjF860yKGQSLzL5EmeXxXOacXOJOW7YjEJzU9q80MmpLf3abcjPgkwkUPc6JOe1BRsM08337WKjAQrMm7AibqPFxmuyJrmgvNBRnHTPCa8PNxKU8dZ5zs6S9shebBFRqMGenCSLIg7DtQDL1gVEhFL4BINUiinxCv43fRbm7ipIKDFqDQ Sep 06 22:53:20.475627 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Sep 06 22:53:20.475627 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Sep 06 22:53:20.475627 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Sep 06 22:53:20.475627 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Sep 06 22:53:20.475627 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Sep 06 22:53:20.475627 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Sep 06 22:53:20.475627 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Id: 121c13a143f447a1822f8df04b1a31a5 Sep 06 22:53:20.475627 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:53:20.475627 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Role: reader,member Sep 06 22:53:20.475627 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Sep 06 22:53:20.477791 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/121c13a143f447a1822f8df04b1a31a5"}]}] Sep 06 22:53:20.477791 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:53:20.477791 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 121c13a143f447a1822f8df04b1a31a5 Sep 06 22:53:20.477791 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:53:20.477791 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeNegativeTest-983971359-project Sep 06 22:53:20.477791 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Sep 06 22:53:20.477791 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Sep 06 22:53:20.477791 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Id: 68515ffe51b74aacb09e8584346e6db3 Sep 06 22:53:20.477791 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeNegativeTest-983971359-project Sep 06 22:53:20.477791 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Sep 06 22:53:20.477791 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: {"volumeAttachment": {"volumeId": "3e7dd3d6-5bb1-4680-aa9d-8d363b45091d"}} Sep 06 22:53:20.477791 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: method: > Sep 06 22:53:20.478756 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: exception: Invalid volume: volume 3e7dd3d6-5bb1-4680-aa9d-8d363b45091d is already attached to instances: dcccaffa-49b8-4d3f-b87d-c23204988c91 Sep 06 22:53:20.478756 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: action_args: {'server_id': 'dcccaffa-49b8-4d3f-b87d-c23204988c91', 'body': {'volumeAttachment': {'volumeId': '3e7dd3d6-5bb1-4680-aa9d-8d363b45091d'}}} Sep 06 22:53:20.478756 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:53:20.478756 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:53:20.478756 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 06 22:53:20.478756 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 06 22:53:20.478756 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 22:53:20.478756 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 22:53:20.478756 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 06 22:53:20.478756 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 06 22:53:20.478756 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 06 22:53:20.478756 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 06 22:53:20.478756 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 06 22:53:20.478756 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 06 22:53:20.478756 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3e7dd3d6-5bb1-4680-aa9d-8d363b45091d is already attached to instances: dcccaffa-49b8-4d3f-b87d-c23204988c91 Sep 06 22:53:20.478756 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:53:20.478756 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:53:20.478756 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:53:20.478756 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:53:20.481744 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:53:20.481744 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:53:20.481744 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:53:20.481744 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:53:20.481744 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:53:20.481744 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:53:20.481744 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 22:53:20.481744 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 22:53:20.481744 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 22:53:20.481744 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 22:53:20.481744 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 22:53:20.481744 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 22:53:20.481744 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 06 22:53:20.481744 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 06 22:53:20.481744 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3e7dd3d6-5bb1-4680-aa9d-8d363b45091d is already attached to instances: dcccaffa-49b8-4d3f-b87d-c23204988c91 Sep 06 22:53:20.481744 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:53:20.481744 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:53:20.481744 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:53:20.481744 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:53:20.481744 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:53:20.483256 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:53:20.483256 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:53:20.483256 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:53:20.483256 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3e7dd3d6-5bb1-4680-aa9d-8d363b45091d is already attached to instances: dcccaffa-49b8-4d3f-b87d-c23204988c91 Sep 06 22:53:20.483256 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:53:20.484696 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-15042d77-523c-4ce4-9e1a-7df7addf0c0e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Returning 400 to user: Invalid volume: volume 3e7dd3d6-5bb1-4680-aa9d-8d363b45091d is already attached to instances: dcccaffa-49b8-4d3f-b87d-c23204988c91 {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:53:20.485945 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-15042d77-523c-4ce4-9e1a-7df7addf0c0e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "POST /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.123429 Sep 06 22:53:20.486523 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 498/1002] 10.222.0.39 () {60 vars in 1323 bytes} [Tue Sep 6 22:53:20 2022] POST /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91/os-volume_attachments => generated 174 bytes in 125 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 22:53:20.563200 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-45805676-01af-4e76-98cf-2821071111a3 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:53:20.563739 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-45805676-01af-4e76-98cf-2821071111a3 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: dcccaffa-49b8-4d3f-b87d-c23204988c91] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:53:20.570974 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-45805676-01af-4e76-98cf-2821071111a3 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:20.571447 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-45805676-01af-4e76-98cf-2821071111a3 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:20.571874 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-45805676-01af-4e76-98cf-2821071111a3 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:20.572560 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-45805676-01af-4e76-98cf-2821071111a3 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:20.573569 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-45805676-01af-4e76-98cf-2821071111a3 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:20.575233 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-45805676-01af-4e76-98cf-2821071111a3 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:20.661376 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.objects.instance [None req-45805676-01af-4e76-98cf-2821071111a3 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lazy-loading 'services' on Instance uuid dcccaffa-49b8-4d3f-b87d-c23204988c91 {{(pid=127087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 22:53:20.734394 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-45805676-01af-4e76-98cf-2821071111a3 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "DELETE /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91/os-volume_attachments/3e7dd3d6-5bb1-4680-aa9d-8d363b45091d" status: 202 len: 0 microversion: 2.1 time: 0.174928 Sep 06 22:53:20.735000 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 505/1003] 10.222.0.39 () {58 vars in 1416 bytes} [Tue Sep 6 22:53:20 2022] DELETE /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91/os-volume_attachments/3e7dd3d6-5bb1-4680-aa9d-8d363b45091d => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 22:53:20.743945 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-95c09cc4-6b00-43e9-a279-302f0bdbf719 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:53:20.746533 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-95c09cc4-6b00-43e9-a279-302f0bdbf719 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: dcccaffa-49b8-4d3f-b87d-c23204988c91] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:53:20.753048 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-95c09cc4-6b00-43e9-a279-302f0bdbf719 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:20.753690 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-95c09cc4-6b00-43e9-a279-302f0bdbf719 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:20.754149 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-95c09cc4-6b00-43e9-a279-302f0bdbf719 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:20.754845 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-95c09cc4-6b00-43e9-a279-302f0bdbf719 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:20.755299 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-95c09cc4-6b00-43e9-a279-302f0bdbf719 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:20.755716 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-95c09cc4-6b00-43e9-a279-302f0bdbf719 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:20.797485 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-95c09cc4-6b00-43e9-a279-302f0bdbf719 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054647 Sep 06 22:53:20.798257 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 499/1004] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Sep 6 22:53:20 2022] GET /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:53:21.811669 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-2c834aef-6168-4742-9f0f-07050cb0a133 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:53:21.813981 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-2c834aef-6168-4742-9f0f-07050cb0a133 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: dcccaffa-49b8-4d3f-b87d-c23204988c91] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:53:21.820355 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2c834aef-6168-4742-9f0f-07050cb0a133 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:21.820997 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2c834aef-6168-4742-9f0f-07050cb0a133 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:21.821425 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2c834aef-6168-4742-9f0f-07050cb0a133 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:21.822110 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2c834aef-6168-4742-9f0f-07050cb0a133 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:21.822546 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2c834aef-6168-4742-9f0f-07050cb0a133 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:21.822957 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2c834aef-6168-4742-9f0f-07050cb0a133 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:21.854009 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-2c834aef-6168-4742-9f0f-07050cb0a133 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047480 Sep 06 22:53:21.860654 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 506/1005] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Sep 6 22:53:21 2022] GET /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 22:53:21.923229 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-58d9af3d-f4aa-4e74-acac-9b05c241142c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:53:21.923747 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-58d9af3d-f4aa-4e74-acac-9b05c241142c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: dcccaffa-49b8-4d3f-b87d-c23204988c91] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:53:21.930076 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-58d9af3d-f4aa-4e74-acac-9b05c241142c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:21.930671 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-58d9af3d-f4aa-4e74-acac-9b05c241142c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:21.931114 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-58d9af3d-f4aa-4e74-acac-9b05c241142c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:21.931813 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-58d9af3d-f4aa-4e74-acac-9b05c241142c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:21.932287 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-58d9af3d-f4aa-4e74-acac-9b05c241142c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:21.932693 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-58d9af3d-f4aa-4e74-acac-9b05c241142c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:21.957993 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-58d9af3d-f4aa-4e74-acac-9b05c241142c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: dcccaffa-49b8-4d3f-b87d-c23204988c91] Going to try to terminate instance {{(pid=127088) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 22:53:22.046263 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-58d9af3d-f4aa-4e74-acac-9b05c241142c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "DELETE /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91" status: 204 len: 0 microversion: 2.1 time: 0.126713 Sep 06 22:53:22.047157 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 500/1006] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Sep 6 22:53:21 2022] DELETE /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 22:53:22.055011 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-0a4617e5-2cab-43b3-823f-d8af919cbd8f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:53:22.055639 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-0a4617e5-2cab-43b3-823f-d8af919cbd8f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: dcccaffa-49b8-4d3f-b87d-c23204988c91] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:53:22.062445 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0a4617e5-2cab-43b3-823f-d8af919cbd8f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:22.062924 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0a4617e5-2cab-43b3-823f-d8af919cbd8f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:22.063365 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0a4617e5-2cab-43b3-823f-d8af919cbd8f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:22.064305 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0a4617e5-2cab-43b3-823f-d8af919cbd8f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:22.064804 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0a4617e5-2cab-43b3-823f-d8af919cbd8f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:22.065221 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-0a4617e5-2cab-43b3-823f-d8af919cbd8f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:22.512324 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-0a4617e5-2cab-43b3-823f-d8af919cbd8f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:53:22.533231 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-0a4617e5-2cab-43b3-823f-d8af919cbd8f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91" status: 200 len: 1681 microversion: 2.1 time: 0.472346 Sep 06 22:53:22.534191 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 507/1007] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:53:22 2022] GET /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91 => generated 1681 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:53:23.556781 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-35694cae-ba81-4645-afbd-066acfaf557a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:53:23.557984 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-35694cae-ba81-4645-afbd-066acfaf557a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: dcccaffa-49b8-4d3f-b87d-c23204988c91] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:53:23.564617 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35694cae-ba81-4645-afbd-066acfaf557a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:23.565132 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35694cae-ba81-4645-afbd-066acfaf557a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:23.565566 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35694cae-ba81-4645-afbd-066acfaf557a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:23.566270 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35694cae-ba81-4645-afbd-066acfaf557a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:23.566723 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35694cae-ba81-4645-afbd-066acfaf557a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:23.567148 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-35694cae-ba81-4645-afbd-066acfaf557a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:23.796417 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-35694cae-ba81-4645-afbd-066acfaf557a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:53:23.803957 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-35694cae-ba81-4645-afbd-066acfaf557a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91" status: 200 len: 1681 microversion: 2.1 time: 0.251623 Sep 06 22:53:23.804516 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 501/1008] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:53:23 2022] GET /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91 => generated 1681 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:53:24.435854 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-bc0f7252-6af6-46d1-8687-a4dea8d88968 req-f0d7fa84-843b-4b34-8145-3b56edf66228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcccaffa-49b8-4d3f-b87d-c23204988c91", "name": "network-vif-deleted", "tag": "e9c46522-6be6-4f46-b035-7c1bf2e2c3ff"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:53:24.453006 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-bc0f7252-6af6-46d1-8687-a4dea8d88968 req-f0d7fa84-843b-4b34-8145-3b56edf66228 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:24.453818 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-bc0f7252-6af6-46d1-8687-a4dea8d88968 req-f0d7fa84-843b-4b34-8145-3b56edf66228 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:24.454252 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-bc0f7252-6af6-46d1-8687-a4dea8d88968 req-f0d7fa84-843b-4b34-8145-3b56edf66228 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:24.467416 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-bc0f7252-6af6-46d1-8687-a4dea8d88968 req-f0d7fa84-843b-4b34-8145-3b56edf66228 service nova] Creating event network-vif-deleted:e9c46522-6be6-4f46-b035-7c1bf2e2c3ff for instance dcccaffa-49b8-4d3f-b87d-c23204988c91 on hv-cinder-85220 Sep 06 22:53:24.476300 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-bc0f7252-6af6-46d1-8687-a4dea8d88968 req-f0d7fa84-843b-4b34-8145-3b56edf66228 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045249 Sep 06 22:53:24.477542 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 508/1009] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:53:24.829077 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a6d13884-722b-4d54-a808-77f044e4a2d0 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:53:24.830317 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a6d13884-722b-4d54-a808-77f044e4a2d0 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: dcccaffa-49b8-4d3f-b87d-c23204988c91] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:53:24.837891 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a6d13884-722b-4d54-a808-77f044e4a2d0 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:24.838387 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a6d13884-722b-4d54-a808-77f044e4a2d0 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:24.839534 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a6d13884-722b-4d54-a808-77f044e4a2d0 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:24.840242 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a6d13884-722b-4d54-a808-77f044e4a2d0 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:24.840692 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a6d13884-722b-4d54-a808-77f044e4a2d0 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:24.841138 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a6d13884-722b-4d54-a808-77f044e4a2d0 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:24.877394 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a6d13884-722b-4d54-a808-77f044e4a2d0 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:24.877877 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a6d13884-722b-4d54-a808-77f044e4a2d0 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:24.878309 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a6d13884-722b-4d54-a808-77f044e4a2d0 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:24.878760 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-a6d13884-722b-4d54-a808-77f044e4a2d0 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lazy-loading 'fault' on Instance uuid dcccaffa-49b8-4d3f-b87d-c23204988c91 {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 22:53:24.922533 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a6d13884-722b-4d54-a808-77f044e4a2d0 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:53:24.930602 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a6d13884-722b-4d54-a808-77f044e4a2d0 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91" status: 200 len: 1332 microversion: 2.1 time: 0.106824 Sep 06 22:53:24.931740 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 502/1010] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:53:24 2022] GET /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91 => generated 1332 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:53:25.955090 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-c63ed530-5a83-4e26-a16a-a131efd7436a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:53:25.955710 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-c63ed530-5a83-4e26-a16a-a131efd7436a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: dcccaffa-49b8-4d3f-b87d-c23204988c91] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:53:25.962216 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c63ed530-5a83-4e26-a16a-a131efd7436a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:25.962684 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c63ed530-5a83-4e26-a16a-a131efd7436a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:25.963108 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c63ed530-5a83-4e26-a16a-a131efd7436a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:25.963850 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c63ed530-5a83-4e26-a16a-a131efd7436a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:25.964311 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c63ed530-5a83-4e26-a16a-a131efd7436a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:25.964721 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c63ed530-5a83-4e26-a16a-a131efd7436a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:25.977404 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-c63ed530-5a83-4e26-a16a-a131efd7436a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] HTTP exception thrown: Instance dcccaffa-49b8-4d3f-b87d-c23204988c91 could not be found. Sep 06 22:53:25.978972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-c63ed530-5a83-4e26-a16a-a131efd7436a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Request method failure captured: Sep 06 22:53:25.978972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: request: GET /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91 HTTP/1.1 Sep 06 22:53:25.978972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept: application/json Sep 06 22:53:25.978972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Sep 06 22:53:25.978972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Connection: close Sep 06 22:53:25.978972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Length: 0 Sep 06 22:53:25.978972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Type: application/json Sep 06 22:53:25.978972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Host: 10.222.0.39 Sep 06 22:53:25.978972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Sep 06 22:53:25.978972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.12 Sep 06 22:53:25.978972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABjF860yKGQSLzL5EmeXxXOacXOJOW7YjEJzU9q80MmpLf3abcjPgkwkUPc6JOe1BRsM08337WKjAQrMm7AibqPFxmuyJrmgvNBRnHTPCa8PNxKU8dZ5zs6S9shebBFRqMGenCSLIg7DtQDL1gVEhFL4BINUiinxCv43fRbm7ipIKDFqDQ Sep 06 22:53:25.978972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Sep 06 22:53:25.978972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Sep 06 22:53:25.978972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Sep 06 22:53:25.978972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Sep 06 22:53:25.978972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Sep 06 22:53:25.978972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Sep 06 22:53:25.978972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Id: 121c13a143f447a1822f8df04b1a31a5 Sep 06 22:53:25.978972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:53:25.978972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Role: reader,member Sep 06 22:53:25.978972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Sep 06 22:53:25.981294 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/121c13a143f447a1822f8df04b1a31a5"}]}] Sep 06 22:53:25.981294 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:53:25.981294 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 121c13a143f447a1822f8df04b1a31a5 Sep 06 22:53:25.981294 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:53:25.981294 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User: tempest-AttachVolumeNegativeTest-983971359-project Sep 06 22:53:25.981294 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Sep 06 22:53:25.981294 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Sep 06 22:53:25.981294 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Id: 68515ffe51b74aacb09e8584346e6db3 Sep 06 22:53:25.981294 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-AttachVolumeNegativeTest-983971359-project Sep 06 22:53:25.981294 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: method: > Sep 06 22:53:25.981294 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: exception: Instance dcccaffa-49b8-4d3f-b87d-c23204988c91 could not be found. Sep 06 22:53:25.981294 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: action_args: {'id': 'dcccaffa-49b8-4d3f-b87d-c23204988c91'} Sep 06 22:53:25.982153 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:53:25.982153 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:53:25.982153 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:53:25.982153 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:53:25.982153 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:53:25.982153 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:53:25.982153 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:53:25.982153 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:53:25.982153 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:53:25.982153 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:53:25.982153 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcccaffa-49b8-4d3f-b87d-c23204988c91 could not be found. Sep 06 22:53:25.982153 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:53:25.982153 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:53:25.982153 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:53:25.982153 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:53:25.982153 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:53:25.982153 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:53:25.982153 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:53:25.982153 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:53:25.982153 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:53:25.983626 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:53:25.983626 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 22:53:25.983626 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 22:53:25.983626 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:53:25.983626 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:53:25.983626 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:53:25.983626 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:53:25.983626 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcccaffa-49b8-4d3f-b87d-c23204988c91 could not be found. Sep 06 22:53:25.983626 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:53:25.983626 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:53:25.983626 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:53:25.983626 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:53:25.983626 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:53:25.983626 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:53:25.983626 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:53:25.983626 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:53:25.983626 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcccaffa-49b8-4d3f-b87d-c23204988c91 could not be found. Sep 06 22:53:25.983626 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:53:25.985099 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-c63ed530-5a83-4e26-a16a-a131efd7436a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Returning 404 to user: Instance dcccaffa-49b8-4d3f-b87d-c23204988c91 could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:53:25.985099 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-c63ed530-5a83-4e26-a16a-a131efd7436a tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91" status: 404 len: 111 microversion: 2.1 time: 0.030374 Sep 06 22:53:25.985099 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 509/1011] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:53:25 2022] GET /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 22:53:25.990346 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7bf7cc93-c773-4917-91a9-1c7f4c12cfaa tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '.version_select at 0x7f9c4f728940>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:53:26.009954 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7bf7cc93-c773-4917-91a9-1c7f4c12cfaa tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1387781795" status: 202 len: 0 microversion: 2.1 time: 0.023624 Sep 06 22:53:26.010523 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 503/1012] 10.222.0.39 () {58 vars in 1221 bytes} [Tue Sep 6 22:53:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1387781795 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 22:53:26.618801 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-c201c3d7-8f47-401a-a543-0f3205b176ea tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Action: 'create', calling method: .version_select at 0x7f9c52e9dd30>, body: {"keypair": {"name": "tempest-keypair-1267842560", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsBfWKe01r6L/adiHiOLUn43KDsOY4qURswiq3qdKsCyz1xzStf1Z4x9c4cVOvM3idY0wflrV8QJhNpUVWfFHKR9d2OG9d4FbgJ4WLa3nyN57WKAsGXFo9PiTwsBJAixw=="}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:53:26.634341 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-c201c3d7-8f47-401a-a543-0f3205b176ea tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Getting quotas for project 121c13a143f447a1822f8df04b1a31a5. Resources: {'key_pairs'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 22:53:26.638105 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-c201c3d7-8f47-401a-a543-0f3205b176ea tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Getting quotas for user 68515ffe51b74aacb09e8584346e6db3 and project 121c13a143f447a1822f8df04b1a31a5. Resources: {'key_pairs'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 22:53:26.659056 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-c201c3d7-8f47-401a-a543-0f3205b176ea tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044135 Sep 06 22:53:26.659625 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 510/1013] 10.222.0.39 () {60 vars in 1159 bytes} [Tue Sep 6 22:53:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:53:27.917312 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-1a9a7809-0792-4c44-b393-d383ef72887d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-664289896", "imageRef": "93326d5e-4826-431e-9ad1-6ee2d44e48d9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "11fd96bf-4fdb-44de-a3da-a6c9f281ae59"}], "security_groups": [{"name": "tempest-securitygroup--917735698"}], "key_name": "tempest-keypair-1267842560", "user_data": "}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:53:28.020825 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.network.neutron [None req-1a9a7809-0792-4c44-b393-d383ef72887d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] validate_networks() for [('11fd96bf-4fdb-44de-a3da-a6c9f281ae59', None, None, None, None, None)] {{(pid=127088) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 22:53:28.406282 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-1a9a7809-0792-4c44-b393-d383ef72887d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Flavor limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 22:53:28.406692 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-1a9a7809-0792-4c44-b393-d383ef72887d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Image limits 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 22:53:28.407150 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-1a9a7809-0792-4c44-b393-d383ef72887d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Flavor pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 22:53:28.407801 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-1a9a7809-0792-4c44-b393-d383ef72887d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Image pref 0:0:0 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 22:53:28.408197 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.virt.hardware [None req-1a9a7809-0792-4c44-b393-d383ef72887d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127088) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 22:53:28.417458 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1a9a7809-0792-4c44-b393-d383ef72887d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:28.417932 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1a9a7809-0792-4c44-b393-d383ef72887d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:28.418352 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1a9a7809-0792-4c44-b393-d383ef72887d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:28.419063 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1a9a7809-0792-4c44-b393-d383ef72887d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:28.419503 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1a9a7809-0792-4c44-b393-d383ef72887d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:28.419913 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-1a9a7809-0792-4c44-b393-d383ef72887d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:28.436037 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-1a9a7809-0792-4c44-b393-d383ef72887d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Getting quotas for project 121c13a143f447a1822f8df04b1a31a5. Resources: {'instances', 'ram', 'cores'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 22:53:28.439939 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-1a9a7809-0792-4c44-b393-d383ef72887d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Getting quotas for user 68515ffe51b74aacb09e8584346e6db3 and project 121c13a143f447a1822f8df04b1a31a5. Resources: {'instances', 'ram', 'cores'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 22:53:28.450874 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1a9a7809-0792-4c44-b393-d383ef72887d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Going to run 1 instances... {{(pid=127088) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 22:53:28.453152 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-1a9a7809-0792-4c44-b393-d383ef72887d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 50cd167f-2d4b-4f6e-91f4-9d768c3385d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='93326d5e-4826-431e-9ad1-6ee2d44e48d9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127088) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 22:53:28.502242 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-1a9a7809-0792-4c44-b393-d383ef72887d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.589813 Sep 06 22:53:28.502896 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 504/1014] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Sep 6 22:53:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 22:53:28.514656 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-04a46e3d-73e5-4ce2-9226-7f28c1747615 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:53:28.515829 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-04a46e3d-73e5-4ce2-9226-7f28c1747615 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 50cd167f-2d4b-4f6e-91f4-9d768c3385d7] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:53:28.573352 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-04a46e3d-73e5-4ce2-9226-7f28c1747615 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:53:28.581136 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-04a46e3d-73e5-4ce2-9226-7f28c1747615 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7" status: 200 len: 1241 microversion: 2.1 time: 0.070890 Sep 06 22:53:28.581701 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 511/1015] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:53:28 2022] GET /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:53:29.605052 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-afe4782b-3e05-4233-a555-ed4833c6e7b5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:53:29.605748 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-afe4782b-3e05-4233-a555-ed4833c6e7b5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 50cd167f-2d4b-4f6e-91f4-9d768c3385d7] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:53:29.612057 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-afe4782b-3e05-4233-a555-ed4833c6e7b5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:29.612539 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-afe4782b-3e05-4233-a555-ed4833c6e7b5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:29.613000 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-afe4782b-3e05-4233-a555-ed4833c6e7b5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:29.613696 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-afe4782b-3e05-4233-a555-ed4833c6e7b5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:29.614143 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-afe4782b-3e05-4233-a555-ed4833c6e7b5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:29.614562 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-afe4782b-3e05-4233-a555-ed4833c6e7b5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:29.683981 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-afe4782b-3e05-4233-a555-ed4833c6e7b5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:53:29.691517 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-afe4782b-3e05-4233-a555-ed4833c6e7b5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7" status: 200 len: 1299 microversion: 2.1 time: 0.092104 Sep 06 22:53:29.692075 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 505/1016] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:53:29 2022] GET /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7 => generated 1299 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:53:30.714855 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-3fd58af1-ab0b-4f7a-af01-f25ab99b55fa tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:53:30.715487 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-3fd58af1-ab0b-4f7a-af01-f25ab99b55fa tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 50cd167f-2d4b-4f6e-91f4-9d768c3385d7] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:53:30.722351 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3fd58af1-ab0b-4f7a-af01-f25ab99b55fa tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:30.722839 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3fd58af1-ab0b-4f7a-af01-f25ab99b55fa tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:30.723275 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3fd58af1-ab0b-4f7a-af01-f25ab99b55fa tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:30.723975 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3fd58af1-ab0b-4f7a-af01-f25ab99b55fa tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:30.724422 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3fd58af1-ab0b-4f7a-af01-f25ab99b55fa tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:30.724874 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-3fd58af1-ab0b-4f7a-af01-f25ab99b55fa tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:30.939199 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-3fd58af1-ab0b-4f7a-af01-f25ab99b55fa tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:53:30.947360 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-3fd58af1-ab0b-4f7a-af01-f25ab99b55fa tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7" status: 200 len: 1366 microversion: 2.1 time: 0.236258 Sep 06 22:53:30.948550 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 512/1017] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:53:30 2022] GET /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:53:30.974691 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-c00fd2a8-bf02-4386-bbb7-44a09ec06bc7 req-147abc01-de7d-423d-ae7c-bf923b1728fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50cd167f-2d4b-4f6e-91f4-9d768c3385d7", "tag": "d54f8c4c-e95f-4745-8570-69c538bf94ac"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:53:30.988149 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-c00fd2a8-bf02-4386-bbb7-44a09ec06bc7 req-147abc01-de7d-423d-ae7c-bf923b1728fd service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:30.988719 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-c00fd2a8-bf02-4386-bbb7-44a09ec06bc7 req-147abc01-de7d-423d-ae7c-bf923b1728fd service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:30.989601 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-c00fd2a8-bf02-4386-bbb7-44a09ec06bc7 req-147abc01-de7d-423d-ae7c-bf923b1728fd service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:31.002470 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-c00fd2a8-bf02-4386-bbb7-44a09ec06bc7 req-147abc01-de7d-423d-ae7c-bf923b1728fd service nova] Creating event network-changed:d54f8c4c-e95f-4745-8570-69c538bf94ac for instance 50cd167f-2d4b-4f6e-91f4-9d768c3385d7 on hv-cinder-85220 Sep 06 22:53:31.007753 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-c00fd2a8-bf02-4386-bbb7-44a09ec06bc7 req-147abc01-de7d-423d-ae7c-bf923b1728fd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036851 Sep 06 22:53:31.008340 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 506/1018] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:53:31.970573 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-5211fbb7-d0db-4cd2-a080-0ceec21a4f9b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:53:31.971169 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-5211fbb7-d0db-4cd2-a080-0ceec21a4f9b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 50cd167f-2d4b-4f6e-91f4-9d768c3385d7] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:53:31.977497 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5211fbb7-d0db-4cd2-a080-0ceec21a4f9b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:31.977962 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5211fbb7-d0db-4cd2-a080-0ceec21a4f9b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:31.978386 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5211fbb7-d0db-4cd2-a080-0ceec21a4f9b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:31.979331 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5211fbb7-d0db-4cd2-a080-0ceec21a4f9b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:31.979776 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5211fbb7-d0db-4cd2-a080-0ceec21a4f9b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:31.980184 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5211fbb7-d0db-4cd2-a080-0ceec21a4f9b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:32.203733 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-5211fbb7-d0db-4cd2-a080-0ceec21a4f9b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:53:32.211295 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-5211fbb7-d0db-4cd2-a080-0ceec21a4f9b tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7" status: 200 len: 1366 microversion: 2.1 time: 0.244692 Sep 06 22:53:32.211853 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 513/1019] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:53:31 2022] GET /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:53:33.235326 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d9dc5d63-83a3-4e94-8c92-3ce2fdeb5f91 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:53:33.236058 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d9dc5d63-83a3-4e94-8c92-3ce2fdeb5f91 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 50cd167f-2d4b-4f6e-91f4-9d768c3385d7] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:53:33.238048 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:53:33.243556 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9dc5d63-83a3-4e94-8c92-3ce2fdeb5f91 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:33.244039 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9dc5d63-83a3-4e94-8c92-3ce2fdeb5f91 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:33.244742 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9dc5d63-83a3-4e94-8c92-3ce2fdeb5f91 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:33.245411 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9dc5d63-83a3-4e94-8c92-3ce2fdeb5f91 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:33.245850 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9dc5d63-83a3-4e94-8c92-3ce2fdeb5f91 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:33.246272 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d9dc5d63-83a3-4e94-8c92-3ce2fdeb5f91 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:33.251011 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:53:33.376949 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-d9dc5d63-83a3-4e94-8c92-3ce2fdeb5f91 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:53:33.384469 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d9dc5d63-83a3-4e94-8c92-3ce2fdeb5f91 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7" status: 200 len: 1366 microversion: 2.1 time: 0.153888 Sep 06 22:53:33.385642 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 507/1020] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:53:33 2022] GET /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:53:34.407919 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-ef11b5d9-f6e0-4bd1-8cd6-d696434a0606 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:53:34.408499 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-ef11b5d9-f6e0-4bd1-8cd6-d696434a0606 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 50cd167f-2d4b-4f6e-91f4-9d768c3385d7] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:53:34.410913 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:53:34.416105 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ef11b5d9-f6e0-4bd1-8cd6-d696434a0606 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:34.417426 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ef11b5d9-f6e0-4bd1-8cd6-d696434a0606 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:34.418012 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ef11b5d9-f6e0-4bd1-8cd6-d696434a0606 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:34.418688 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ef11b5d9-f6e0-4bd1-8cd6-d696434a0606 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:34.419199 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ef11b5d9-f6e0-4bd1-8cd6-d696434a0606 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:34.419616 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-ef11b5d9-f6e0-4bd1-8cd6-d696434a0606 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:34.423004 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:53:34.549265 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-ef11b5d9-f6e0-4bd1-8cd6-d696434a0606 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:53:34.556891 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-ef11b5d9-f6e0-4bd1-8cd6-d696434a0606 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7" status: 200 len: 1366 microversion: 2.1 time: 0.153033 Sep 06 22:53:34.557501 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 514/1021] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:53:34 2022] GET /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:53:35.579566 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4742f7e5-3541-461e-a5ac-b15145680f3e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:53:35.580171 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4742f7e5-3541-461e-a5ac-b15145680f3e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 50cd167f-2d4b-4f6e-91f4-9d768c3385d7] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:53:35.586558 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4742f7e5-3541-461e-a5ac-b15145680f3e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:35.587031 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4742f7e5-3541-461e-a5ac-b15145680f3e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:35.587487 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4742f7e5-3541-461e-a5ac-b15145680f3e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:35.588188 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4742f7e5-3541-461e-a5ac-b15145680f3e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:35.588634 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4742f7e5-3541-461e-a5ac-b15145680f3e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:35.589080 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4742f7e5-3541-461e-a5ac-b15145680f3e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:35.721866 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4742f7e5-3541-461e-a5ac-b15145680f3e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:53:35.730686 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4742f7e5-3541-461e-a5ac-b15145680f3e tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7" status: 200 len: 1366 microversion: 2.1 time: 0.155040 Sep 06 22:53:35.731549 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 508/1022] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:53:35 2022] GET /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:53:35.825783 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-57e49453-08b8-40a1-9cda-c0f29f652057 req-c54032d8-8463-4276-8aef-12450b5d7855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50cd167f-2d4b-4f6e-91f4-9d768c3385d7", "name": "network-vif-plugged", "status": "completed", "tag": "d54f8c4c-e95f-4745-8570-69c538bf94ac"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:53:35.836279 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-57e49453-08b8-40a1-9cda-c0f29f652057 req-c54032d8-8463-4276-8aef-12450b5d7855 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:35.837007 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-57e49453-08b8-40a1-9cda-c0f29f652057 req-c54032d8-8463-4276-8aef-12450b5d7855 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:35.837434 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-57e49453-08b8-40a1-9cda-c0f29f652057 req-c54032d8-8463-4276-8aef-12450b5d7855 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:35.848271 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-57e49453-08b8-40a1-9cda-c0f29f652057 req-c54032d8-8463-4276-8aef-12450b5d7855 service nova] Creating event network-vif-plugged:d54f8c4c-e95f-4745-8570-69c538bf94ac for instance 50cd167f-2d4b-4f6e-91f4-9d768c3385d7 on hv-cinder-85220 Sep 06 22:53:35.853236 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-57e49453-08b8-40a1-9cda-c0f29f652057 req-c54032d8-8463-4276-8aef-12450b5d7855 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031689 Sep 06 22:53:35.854564 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 515/1023] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:53:36.753343 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-efe3cd7b-9630-4c40-88a8-f805e4fdaa2d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:53:36.753873 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-efe3cd7b-9630-4c40-88a8-f805e4fdaa2d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 50cd167f-2d4b-4f6e-91f4-9d768c3385d7] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:53:36.760729 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-efe3cd7b-9630-4c40-88a8-f805e4fdaa2d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:36.761228 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-efe3cd7b-9630-4c40-88a8-f805e4fdaa2d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:36.761650 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-efe3cd7b-9630-4c40-88a8-f805e4fdaa2d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:36.762321 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-efe3cd7b-9630-4c40-88a8-f805e4fdaa2d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:36.762759 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-efe3cd7b-9630-4c40-88a8-f805e4fdaa2d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:36.763165 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-efe3cd7b-9630-4c40-88a8-f805e4fdaa2d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:37.182303 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-efe3cd7b-9630-4c40-88a8-f805e4fdaa2d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:53:37.189803 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-efe3cd7b-9630-4c40-88a8-f805e4fdaa2d tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7" status: 200 len: 1366 microversion: 2.1 time: 0.440421 Sep 06 22:53:37.190356 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 509/1024] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:53:36 2022] GET /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7 => generated 1366 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:53:38.214506 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e7f0f510-3e24-4795-8b99-f2f01d325743 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:53:38.215110 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e7f0f510-3e24-4795-8b99-f2f01d325743 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 50cd167f-2d4b-4f6e-91f4-9d768c3385d7] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:53:38.221662 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e7f0f510-3e24-4795-8b99-f2f01d325743 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:38.222126 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e7f0f510-3e24-4795-8b99-f2f01d325743 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:38.222546 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e7f0f510-3e24-4795-8b99-f2f01d325743 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:38.223217 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e7f0f510-3e24-4795-8b99-f2f01d325743 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:38.223656 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e7f0f510-3e24-4795-8b99-f2f01d325743 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:38.224064 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e7f0f510-3e24-4795-8b99-f2f01d325743 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:38.350439 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e7f0f510-3e24-4795-8b99-f2f01d325743 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:53:38.358723 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e7f0f510-3e24-4795-8b99-f2f01d325743 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7" status: 200 len: 1556 microversion: 2.1 time: 0.149040 Sep 06 22:53:38.359401 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 516/1025] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:53:38 2022] GET /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7 => generated 1556 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:53:38.382818 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fd0252b2-1ca5-497a-b2c9-0a8e25fded17 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:53:38.383304 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fd0252b2-1ca5-497a-b2c9-0a8e25fded17 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 50cd167f-2d4b-4f6e-91f4-9d768c3385d7] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:53:38.389889 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fd0252b2-1ca5-497a-b2c9-0a8e25fded17 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:38.390356 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fd0252b2-1ca5-497a-b2c9-0a8e25fded17 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:38.390783 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fd0252b2-1ca5-497a-b2c9-0a8e25fded17 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:38.391464 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fd0252b2-1ca5-497a-b2c9-0a8e25fded17 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:38.391909 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fd0252b2-1ca5-497a-b2c9-0a8e25fded17 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:38.392319 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fd0252b2-1ca5-497a-b2c9-0a8e25fded17 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:38.425926 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:53:38.446597 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=6 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:53:38.468890 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fd0252b2-1ca5-497a-b2c9-0a8e25fded17 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089834 Sep 06 22:53:38.469562 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 510/1026] 10.222.0.39 () {58 vars in 1275 bytes} [Tue Sep 6 22:53:38 2022] GET /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:53:39.387799 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-cf4e6a1d-15ea-481c-bbb9-b24abeb816b2 req-05262117-f053-4873-b1d7-5ae671dc8fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50cd167f-2d4b-4f6e-91f4-9d768c3385d7", "tag": "d54f8c4c-e95f-4745-8570-69c538bf94ac"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:53:39.392689 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=6 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:53:39.399219 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-cf4e6a1d-15ea-481c-bbb9-b24abeb816b2 req-05262117-f053-4873-b1d7-5ae671dc8fb2 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:53:39.399769 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-cf4e6a1d-15ea-481c-bbb9-b24abeb816b2 req-05262117-f053-4873-b1d7-5ae671dc8fb2 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:53:39.400191 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-cf4e6a1d-15ea-481c-bbb9-b24abeb816b2 req-05262117-f053-4873-b1d7-5ae671dc8fb2 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:53:39.412171 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-cf4e6a1d-15ea-481c-bbb9-b24abeb816b2 req-05262117-f053-4873-b1d7-5ae671dc8fb2 service nova] Creating event network-changed:d54f8c4c-e95f-4745-8570-69c538bf94ac for instance 50cd167f-2d4b-4f6e-91f4-9d768c3385d7 on hv-cinder-85220 Sep 06 22:53:39.417761 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-cf4e6a1d-15ea-481c-bbb9-b24abeb816b2 req-05262117-f053-4873-b1d7-5ae671dc8fb2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034484 Sep 06 22:53:39.418349 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 517/1027] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:54:13.245754 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=7 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:54:13.246555 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=21 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:54:13.251212 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d4a4ffbd-361e-41f8-83f9-d8a23f3bdaaf tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:54:13.251691 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d4a4ffbd-361e-41f8-83f9-d8a23f3bdaaf tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 50cd167f-2d4b-4f6e-91f4-9d768c3385d7] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:54:13.258364 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d4a4ffbd-361e-41f8-83f9-d8a23f3bdaaf tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:54:13.258872 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d4a4ffbd-361e-41f8-83f9-d8a23f3bdaaf tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:54:13.259380 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d4a4ffbd-361e-41f8-83f9-d8a23f3bdaaf tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:54:13.260133 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d4a4ffbd-361e-41f8-83f9-d8a23f3bdaaf tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:54:13.260578 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d4a4ffbd-361e-41f8-83f9-d8a23f3bdaaf tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:54:13.261361 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d4a4ffbd-361e-41f8-83f9-d8a23f3bdaaf tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:54:13.286908 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d4a4ffbd-361e-41f8-83f9-d8a23f3bdaaf tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7/ips" status: 200 len: 150 microversion: 2.1 time: 0.043025 Sep 06 22:54:13.287556 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 511/1028] 10.222.0.39 () {58 vars in 1248 bytes} [Tue Sep 6 22:54:13 2022] GET /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:54:14.646033 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=7 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:54:14.646818 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=15 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:54:14.652177 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-5365c5d2-7388-4368-a02e-ee699c5604ee tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ef1e3d8-da4e-4c18-a8cb-a1f8abf54ea5"}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:54:14.654571 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-5365c5d2-7388-4368-a02e-ee699c5604ee tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 50cd167f-2d4b-4f6e-91f4-9d768c3385d7] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:54:14.661841 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5365c5d2-7388-4368-a02e-ee699c5604ee tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:54:14.662309 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5365c5d2-7388-4368-a02e-ee699c5604ee tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:54:14.662732 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5365c5d2-7388-4368-a02e-ee699c5604ee tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:54:14.663396 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5365c5d2-7388-4368-a02e-ee699c5604ee tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:54:14.663840 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5365c5d2-7388-4368-a02e-ee699c5604ee tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:54:14.664249 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5365c5d2-7388-4368-a02e-ee699c5604ee tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:54:14.901670 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-5365c5d2-7388-4368-a02e-ee699c5604ee tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "POST /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256898 Sep 06 22:54:14.902273 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 518/1029] 10.222.0.39 () {60 vars in 1323 bytes} [Tue Sep 6 22:54:14 2022] POST /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:54:21.481661 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-93905556-38a8-4216-8d55-2aaed1bfdba2 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:54:21.482190 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-93905556-38a8-4216-8d55-2aaed1bfdba2 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 50cd167f-2d4b-4f6e-91f4-9d768c3385d7] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:54:21.488081 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-93905556-38a8-4216-8d55-2aaed1bfdba2 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:54:21.488560 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-93905556-38a8-4216-8d55-2aaed1bfdba2 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:54:21.489025 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-93905556-38a8-4216-8d55-2aaed1bfdba2 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:54:21.489706 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-93905556-38a8-4216-8d55-2aaed1bfdba2 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:54:21.490150 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-93905556-38a8-4216-8d55-2aaed1bfdba2 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:54:21.490561 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-93905556-38a8-4216-8d55-2aaed1bfdba2 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:54:21.570213 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-93905556-38a8-4216-8d55-2aaed1bfdba2 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lazy-loading 'services' on Instance uuid 50cd167f-2d4b-4f6e-91f4-9d768c3385d7 {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 22:54:21.644109 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-93905556-38a8-4216-8d55-2aaed1bfdba2 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "DELETE /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7/os-volume_attachments/4ef1e3d8-da4e-4c18-a8cb-a1f8abf54ea5" status: 202 len: 0 microversion: 2.1 time: 0.166260 Sep 06 22:54:21.644790 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 512/1030] 10.222.0.39 () {58 vars in 1416 bytes} [Tue Sep 6 22:54:21 2022] DELETE /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7/os-volume_attachments/4ef1e3d8-da4e-4c18-a8cb-a1f8abf54ea5 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 22:54:21.654901 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d3b8d4ca-05fe-4918-8f72-d6760c1926c2 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:54:21.657520 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-d3b8d4ca-05fe-4918-8f72-d6760c1926c2 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 50cd167f-2d4b-4f6e-91f4-9d768c3385d7] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:54:21.663953 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d3b8d4ca-05fe-4918-8f72-d6760c1926c2 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:54:21.664432 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d3b8d4ca-05fe-4918-8f72-d6760c1926c2 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:54:21.664936 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d3b8d4ca-05fe-4918-8f72-d6760c1926c2 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:54:21.665685 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d3b8d4ca-05fe-4918-8f72-d6760c1926c2 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:54:21.666070 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d3b8d4ca-05fe-4918-8f72-d6760c1926c2 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:54:21.666475 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d3b8d4ca-05fe-4918-8f72-d6760c1926c2 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:54:21.706424 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d3b8d4ca-05fe-4918-8f72-d6760c1926c2 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057053 Sep 06 22:54:21.706990 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 519/1031] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Sep 6 22:54:21 2022] GET /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:54:22.720117 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-69819d39-a299-43d9-a9b6-ef0a649b903f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:54:22.722717 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-69819d39-a299-43d9-a9b6-ef0a649b903f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 50cd167f-2d4b-4f6e-91f4-9d768c3385d7] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:54:22.729590 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69819d39-a299-43d9-a9b6-ef0a649b903f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:54:22.730072 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69819d39-a299-43d9-a9b6-ef0a649b903f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:54:22.730507 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69819d39-a299-43d9-a9b6-ef0a649b903f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:54:22.731198 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69819d39-a299-43d9-a9b6-ef0a649b903f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:54:22.731652 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69819d39-a299-43d9-a9b6-ef0a649b903f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:54:22.732073 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-69819d39-a299-43d9-a9b6-ef0a649b903f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:54:22.760236 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-69819d39-a299-43d9-a9b6-ef0a649b903f tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044524 Sep 06 22:54:22.760808 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 513/1032] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Sep 6 22:54:22 2022] GET /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 22:54:22.824192 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d0b74985-2972-4e58-a2f4-911d3211a007 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:54:22.824797 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-d0b74985-2972-4e58-a2f4-911d3211a007 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 50cd167f-2d4b-4f6e-91f4-9d768c3385d7] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:54:22.831034 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d0b74985-2972-4e58-a2f4-911d3211a007 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:54:22.831444 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d0b74985-2972-4e58-a2f4-911d3211a007 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:54:22.831866 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d0b74985-2972-4e58-a2f4-911d3211a007 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:54:22.832540 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d0b74985-2972-4e58-a2f4-911d3211a007 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:54:22.833002 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d0b74985-2972-4e58-a2f4-911d3211a007 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:54:22.833416 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d0b74985-2972-4e58-a2f4-911d3211a007 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:54:23.003918 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-d0b74985-2972-4e58-a2f4-911d3211a007 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 50cd167f-2d4b-4f6e-91f4-9d768c3385d7] Going to try to terminate instance {{(pid=127087) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 22:54:23.075952 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d0b74985-2972-4e58-a2f4-911d3211a007 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "DELETE /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7" status: 204 len: 0 microversion: 2.1 time: 0.255984 Sep 06 22:54:23.076527 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 520/1033] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Sep 6 22:54:22 2022] DELETE /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 22:54:23.085827 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-08f4d3e9-8f24-4812-9250-c2f27f876670 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:54:23.086373 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-08f4d3e9-8f24-4812-9250-c2f27f876670 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 50cd167f-2d4b-4f6e-91f4-9d768c3385d7] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:54:23.093367 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-08f4d3e9-8f24-4812-9250-c2f27f876670 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:54:23.093845 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-08f4d3e9-8f24-4812-9250-c2f27f876670 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:54:23.094277 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-08f4d3e9-8f24-4812-9250-c2f27f876670 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:54:23.094977 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-08f4d3e9-8f24-4812-9250-c2f27f876670 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:54:23.095411 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-08f4d3e9-8f24-4812-9250-c2f27f876670 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:54:23.095917 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-08f4d3e9-8f24-4812-9250-c2f27f876670 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:54:23.230830 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-08f4d3e9-8f24-4812-9250-c2f27f876670 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:54:23.238768 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-08f4d3e9-8f24-4812-9250-c2f27f876670 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7" status: 200 len: 1681 microversion: 2.1 time: 0.157738 Sep 06 22:54:23.239368 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 514/1034] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:54:23 2022] GET /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:54:24.262987 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-e9d15537-0590-4fd6-97b8-552649c3ecfa tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:54:24.263751 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-e9d15537-0590-4fd6-97b8-552649c3ecfa tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 50cd167f-2d4b-4f6e-91f4-9d768c3385d7] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:54:24.270382 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e9d15537-0590-4fd6-97b8-552649c3ecfa tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:54:24.270836 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e9d15537-0590-4fd6-97b8-552649c3ecfa tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:54:24.271253 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e9d15537-0590-4fd6-97b8-552649c3ecfa tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:54:24.271965 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e9d15537-0590-4fd6-97b8-552649c3ecfa tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:54:24.272403 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e9d15537-0590-4fd6-97b8-552649c3ecfa tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:54:24.272841 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-e9d15537-0590-4fd6-97b8-552649c3ecfa tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:54:24.408880 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-e9d15537-0590-4fd6-97b8-552649c3ecfa tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:54:24.416515 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-e9d15537-0590-4fd6-97b8-552649c3ecfa tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7" status: 200 len: 1681 microversion: 2.1 time: 0.158461 Sep 06 22:54:24.417101 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 521/1035] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:54:24 2022] GET /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:54:25.450481 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-988bd24d-7ed6-4787-9739-3dc782fc36e5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:54:25.451331 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-988bd24d-7ed6-4787-9739-3dc782fc36e5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 50cd167f-2d4b-4f6e-91f4-9d768c3385d7] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:54:25.458680 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-988bd24d-7ed6-4787-9739-3dc782fc36e5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:54:25.460728 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-988bd24d-7ed6-4787-9739-3dc782fc36e5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:54:25.462317 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-988bd24d-7ed6-4787-9739-3dc782fc36e5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:54:25.464167 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-988bd24d-7ed6-4787-9739-3dc782fc36e5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:54:25.465296 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-988bd24d-7ed6-4787-9739-3dc782fc36e5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:54:25.466293 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-988bd24d-7ed6-4787-9739-3dc782fc36e5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:54:25.530417 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-988bd24d-7ed6-4787-9739-3dc782fc36e5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:54:25.531028 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-988bd24d-7ed6-4787-9739-3dc782fc36e5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:54:25.531539 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-988bd24d-7ed6-4787-9739-3dc782fc36e5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:54:25.533083 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.objects.instance [None req-988bd24d-7ed6-4787-9739-3dc782fc36e5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lazy-loading 'fault' on Instance uuid 50cd167f-2d4b-4f6e-91f4-9d768c3385d7 {{(pid=127087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 22:54:25.534348 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-81d92784-9b67-44f9-92ad-357d4a99068a req-9418795f-bc18-4b42-9f05-6f093a338d78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50cd167f-2d4b-4f6e-91f4-9d768c3385d7", "name": "network-vif-deleted", "tag": "d54f8c4c-e95f-4745-8570-69c538bf94ac"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:54:25.561196 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-81d92784-9b67-44f9-92ad-357d4a99068a req-9418795f-bc18-4b42-9f05-6f093a338d78 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:54:25.561841 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-81d92784-9b67-44f9-92ad-357d4a99068a req-9418795f-bc18-4b42-9f05-6f093a338d78 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:54:25.562518 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-81d92784-9b67-44f9-92ad-357d4a99068a req-9418795f-bc18-4b42-9f05-6f093a338d78 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:54:25.581301 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-81d92784-9b67-44f9-92ad-357d4a99068a req-9418795f-bc18-4b42-9f05-6f093a338d78 service nova] Creating event network-vif-deleted:d54f8c4c-e95f-4745-8570-69c538bf94ac for instance 50cd167f-2d4b-4f6e-91f4-9d768c3385d7 on hv-cinder-85220 Sep 06 22:54:25.587737 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-988bd24d-7ed6-4787-9739-3dc782fc36e5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68515ffe51b74aacb09e8584346e6db3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '121c13a143f447a1822f8df04b1a31a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:54:25.597515 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-988bd24d-7ed6-4787-9739-3dc782fc36e5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7" status: 200 len: 1331 microversion: 2.1 time: 0.160447 Sep 06 22:54:25.600097 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-81d92784-9b67-44f9-92ad-357d4a99068a req-9418795f-bc18-4b42-9f05-6f093a338d78 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.233716 Sep 06 22:54:25.601773 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 515/1036] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:54:25.607355 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 522/1037] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:54:25 2022] GET /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7 => generated 1331 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:54:26.623053 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e165791c-6198-4234-af10-6219c11c0063 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:54:26.623777 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e165791c-6198-4234-af10-6219c11c0063 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 50cd167f-2d4b-4f6e-91f4-9d768c3385d7] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:54:26.630632 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e165791c-6198-4234-af10-6219c11c0063 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:54:26.631119 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e165791c-6198-4234-af10-6219c11c0063 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:54:26.631557 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e165791c-6198-4234-af10-6219c11c0063 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:54:26.632275 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e165791c-6198-4234-af10-6219c11c0063 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:54:26.632728 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e165791c-6198-4234-af10-6219c11c0063 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:54:26.633185 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e165791c-6198-4234-af10-6219c11c0063 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:54:26.646424 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-e165791c-6198-4234-af10-6219c11c0063 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] HTTP exception thrown: Instance 50cd167f-2d4b-4f6e-91f4-9d768c3385d7 could not be found. Sep 06 22:54:26.648038 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e165791c-6198-4234-af10-6219c11c0063 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Request method failure captured: Sep 06 22:54:26.648038 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: request: GET /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7 HTTP/1.1 Sep 06 22:54:26.648038 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept: application/json Sep 06 22:54:26.648038 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Sep 06 22:54:26.648038 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Connection: close Sep 06 22:54:26.648038 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Length: 0 Sep 06 22:54:26.648038 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Type: application/json Sep 06 22:54:26.648038 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Host: 10.222.0.39 Sep 06 22:54:26.648038 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Sep 06 22:54:26.648038 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Sep 06 22:54:26.648038 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjF860yKGQSLzL5EmeXxXOacXOJOW7YjEJzU9q80MmpLf3abcjPgkwkUPc6JOe1BRsM08337WKjAQrMm7AibqPFxmuyJrmgvNBRnHTPCa8PNxKU8dZ5zs6S9shebBFRqMGenCSLIg7DtQDL1gVEhFL4BINUiinxCv43fRbm7ipIKDFqDQ Sep 06 22:54:26.648038 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Sep 06 22:54:26.648038 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Sep 06 22:54:26.648038 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Sep 06 22:54:26.648038 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Sep 06 22:54:26.648038 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Sep 06 22:54:26.648038 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Sep 06 22:54:26.648038 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Id: 121c13a143f447a1822f8df04b1a31a5 Sep 06 22:54:26.648038 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:54:26.648038 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Role: reader,member Sep 06 22:54:26.648038 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Sep 06 22:54:26.649747 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/121c13a143f447a1822f8df04b1a31a5"}]}] Sep 06 22:54:26.649747 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:54:26.649747 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 121c13a143f447a1822f8df04b1a31a5 Sep 06 22:54:26.649747 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:54:26.649747 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeNegativeTest-983971359-project Sep 06 22:54:26.649747 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Sep 06 22:54:26.649747 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Sep 06 22:54:26.649747 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Id: 68515ffe51b74aacb09e8584346e6db3 Sep 06 22:54:26.649747 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeNegativeTest-983971359-project Sep 06 22:54:26.649747 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: method: > Sep 06 22:54:26.649747 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: exception: Instance 50cd167f-2d4b-4f6e-91f4-9d768c3385d7 could not be found. Sep 06 22:54:26.649747 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: action_args: {'id': '50cd167f-2d4b-4f6e-91f4-9d768c3385d7'} Sep 06 22:54:26.650585 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:54:26.650585 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:54:26.650585 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:54:26.650585 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:54:26.650585 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:54:26.650585 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:54:26.650585 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:54:26.650585 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:54:26.650585 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:54:26.650585 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:54:26.650585 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50cd167f-2d4b-4f6e-91f4-9d768c3385d7 could not be found. Sep 06 22:54:26.650585 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:54:26.650585 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:54:26.650585 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:54:26.650585 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:54:26.650585 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:54:26.650585 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:54:26.650585 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:54:26.650585 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:54:26.650585 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:54:26.652451 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:54:26.652451 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 22:54:26.652451 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 22:54:26.652451 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:54:26.652451 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:54:26.652451 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:54:26.652451 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:54:26.652451 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50cd167f-2d4b-4f6e-91f4-9d768c3385d7 could not be found. Sep 06 22:54:26.652451 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:54:26.652451 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:54:26.652451 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:54:26.652451 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:54:26.652451 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:54:26.652451 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:54:26.652451 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:54:26.652451 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:54:26.652451 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50cd167f-2d4b-4f6e-91f4-9d768c3385d7 could not be found. Sep 06 22:54:26.652451 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:54:26.654001 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e165791c-6198-4234-af10-6219c11c0063 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Returning 404 to user: Instance 50cd167f-2d4b-4f6e-91f4-9d768c3385d7 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:54:26.654001 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e165791c-6198-4234-af10-6219c11c0063 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7" status: 404 len: 111 microversion: 2.1 time: 0.031451 Sep 06 22:54:26.654001 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 516/1038] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:54:26 2022] GET /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 22:54:26.658724 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-f98a4c62-713a-4809-a959-886fff4922a5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '.version_select at 0x7f9c52edd670>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:54:26.679318 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-f98a4c62-713a-4809-a959-886fff4922a5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1267842560" status: 202 len: 0 microversion: 2.1 time: 0.024608 Sep 06 22:54:26.679871 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 523/1039] 10.222.0.39 () {58 vars in 1221 bytes} [Tue Sep 6 22:54:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1267842560 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 22:54:28.409427 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-882fe76b-9a9c-4193-a25d-c421eb8209e5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:54:28.409987 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-882fe76b-9a9c-4193-a25d-c421eb8209e5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 50cd167f-2d4b-4f6e-91f4-9d768c3385d7] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:54:28.416025 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-882fe76b-9a9c-4193-a25d-c421eb8209e5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:54:28.416507 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-882fe76b-9a9c-4193-a25d-c421eb8209e5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:54:28.416976 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-882fe76b-9a9c-4193-a25d-c421eb8209e5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:54:28.418248 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-882fe76b-9a9c-4193-a25d-c421eb8209e5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:54:28.418698 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-882fe76b-9a9c-4193-a25d-c421eb8209e5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:54:28.419122 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-882fe76b-9a9c-4193-a25d-c421eb8209e5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:54:28.432375 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-882fe76b-9a9c-4193-a25d-c421eb8209e5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] HTTP exception thrown: Instance 50cd167f-2d4b-4f6e-91f4-9d768c3385d7 could not be found. Sep 06 22:54:28.433958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-882fe76b-9a9c-4193-a25d-c421eb8209e5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Request method failure captured: Sep 06 22:54:28.433958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: request: DELETE /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7 HTTP/1.1 Sep 06 22:54:28.433958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept: application/json Sep 06 22:54:28.433958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Sep 06 22:54:28.433958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Connection: close Sep 06 22:54:28.433958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Length: 0 Sep 06 22:54:28.433958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Type: application/json Sep 06 22:54:28.433958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Host: 10.222.0.39 Sep 06 22:54:28.433958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Sep 06 22:54:28.433958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Sep 06 22:54:28.433958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjF860yKGQSLzL5EmeXxXOacXOJOW7YjEJzU9q80MmpLf3abcjPgkwkUPc6JOe1BRsM08337WKjAQrMm7AibqPFxmuyJrmgvNBRnHTPCa8PNxKU8dZ5zs6S9shebBFRqMGenCSLIg7DtQDL1gVEhFL4BINUiinxCv43fRbm7ipIKDFqDQ Sep 06 22:54:28.433958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Sep 06 22:54:28.433958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Sep 06 22:54:28.433958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Sep 06 22:54:28.433958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Sep 06 22:54:28.433958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Sep 06 22:54:28.433958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Sep 06 22:54:28.433958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Id: 121c13a143f447a1822f8df04b1a31a5 Sep 06 22:54:28.433958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:54:28.433958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Role: reader,member Sep 06 22:54:28.433958 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Sep 06 22:54:28.435625 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/121c13a143f447a1822f8df04b1a31a5"}]}] Sep 06 22:54:28.435625 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:54:28.435625 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 121c13a143f447a1822f8df04b1a31a5 Sep 06 22:54:28.435625 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:54:28.435625 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeNegativeTest-983971359-project Sep 06 22:54:28.435625 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Sep 06 22:54:28.435625 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Sep 06 22:54:28.435625 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Id: 68515ffe51b74aacb09e8584346e6db3 Sep 06 22:54:28.435625 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeNegativeTest-983971359-project Sep 06 22:54:28.435625 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: method: > Sep 06 22:54:28.435625 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: exception: Instance 50cd167f-2d4b-4f6e-91f4-9d768c3385d7 could not be found. Sep 06 22:54:28.435625 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: action_args: {'id': '50cd167f-2d4b-4f6e-91f4-9d768c3385d7'} Sep 06 22:54:28.436448 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:54:28.436448 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:54:28.436448 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:54:28.436448 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:54:28.436448 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:54:28.436448 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:54:28.436448 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:54:28.436448 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:54:28.436448 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:54:28.436448 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:54:28.436448 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50cd167f-2d4b-4f6e-91f4-9d768c3385d7 could not be found. Sep 06 22:54:28.436448 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:54:28.436448 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:54:28.436448 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:54:28.436448 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:54:28.436448 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:54:28.436448 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:54:28.436448 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:54:28.436448 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:54:28.436448 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:54:28.437998 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:54:28.437998 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 22:54:28.437998 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 22:54:28.437998 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 22:54:28.437998 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 22:54:28.437998 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:54:28.437998 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:54:28.437998 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:54:28.437998 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:54:28.437998 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50cd167f-2d4b-4f6e-91f4-9d768c3385d7 could not be found. Sep 06 22:54:28.437998 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:54:28.437998 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:54:28.437998 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:54:28.437998 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:54:28.437998 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:54:28.437998 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:54:28.437998 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:54:28.437998 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:54:28.437998 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50cd167f-2d4b-4f6e-91f4-9d768c3385d7 could not be found. Sep 06 22:54:28.437998 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:54:28.439610 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-882fe76b-9a9c-4193-a25d-c421eb8209e5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Returning 404 to user: Instance 50cd167f-2d4b-4f6e-91f4-9d768c3385d7 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:54:28.439610 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-882fe76b-9a9c-4193-a25d-c421eb8209e5 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "DELETE /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7" status: 404 len: 111 microversion: 2.1 time: 0.031702 Sep 06 22:54:28.439610 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 517/1040] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Sep 6 22:54:28 2022] DELETE /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 22:54:28.444167 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-8d6840e0-dd3b-4a6e-aff6-c3dac41801c7 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:54:28.444800 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-8d6840e0-dd3b-4a6e-aff6-c3dac41801c7 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 50cd167f-2d4b-4f6e-91f4-9d768c3385d7] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:54:28.452071 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8d6840e0-dd3b-4a6e-aff6-c3dac41801c7 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:54:28.452548 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8d6840e0-dd3b-4a6e-aff6-c3dac41801c7 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:54:28.453001 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8d6840e0-dd3b-4a6e-aff6-c3dac41801c7 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:54:28.453691 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8d6840e0-dd3b-4a6e-aff6-c3dac41801c7 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:54:28.454134 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8d6840e0-dd3b-4a6e-aff6-c3dac41801c7 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:54:28.454550 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-8d6840e0-dd3b-4a6e-aff6-c3dac41801c7 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:54:28.468134 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-8d6840e0-dd3b-4a6e-aff6-c3dac41801c7 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] HTTP exception thrown: Instance 50cd167f-2d4b-4f6e-91f4-9d768c3385d7 could not be found. Sep 06 22:54:28.469837 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-8d6840e0-dd3b-4a6e-aff6-c3dac41801c7 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Request method failure captured: Sep 06 22:54:28.469837 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: request: GET /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7 HTTP/1.1 Sep 06 22:54:28.469837 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept: application/json Sep 06 22:54:28.469837 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Sep 06 22:54:28.469837 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Connection: close Sep 06 22:54:28.469837 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Length: 0 Sep 06 22:54:28.469837 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Type: application/json Sep 06 22:54:28.469837 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Host: 10.222.0.39 Sep 06 22:54:28.469837 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Sep 06 22:54:28.469837 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.12 Sep 06 22:54:28.469837 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABjF860yKGQSLzL5EmeXxXOacXOJOW7YjEJzU9q80MmpLf3abcjPgkwkUPc6JOe1BRsM08337WKjAQrMm7AibqPFxmuyJrmgvNBRnHTPCa8PNxKU8dZ5zs6S9shebBFRqMGenCSLIg7DtQDL1gVEhFL4BINUiinxCv43fRbm7ipIKDFqDQ Sep 06 22:54:28.469837 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Sep 06 22:54:28.469837 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Sep 06 22:54:28.469837 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Sep 06 22:54:28.469837 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Sep 06 22:54:28.469837 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Sep 06 22:54:28.469837 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Sep 06 22:54:28.469837 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Id: 121c13a143f447a1822f8df04b1a31a5 Sep 06 22:54:28.469837 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:54:28.469837 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Role: reader,member Sep 06 22:54:28.469837 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Sep 06 22:54:28.471530 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/121c13a143f447a1822f8df04b1a31a5"}]}] Sep 06 22:54:28.471530 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:54:28.471530 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 121c13a143f447a1822f8df04b1a31a5 Sep 06 22:54:28.471530 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:54:28.471530 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User: tempest-AttachVolumeNegativeTest-983971359-project Sep 06 22:54:28.471530 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Sep 06 22:54:28.471530 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Sep 06 22:54:28.471530 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Id: 68515ffe51b74aacb09e8584346e6db3 Sep 06 22:54:28.471530 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-AttachVolumeNegativeTest-983971359-project Sep 06 22:54:28.471530 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: method: > Sep 06 22:54:28.471530 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: exception: Instance 50cd167f-2d4b-4f6e-91f4-9d768c3385d7 could not be found. Sep 06 22:54:28.471530 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: action_args: {'id': '50cd167f-2d4b-4f6e-91f4-9d768c3385d7'} Sep 06 22:54:28.472883 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:54:28.472883 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:54:28.472883 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:54:28.472883 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:54:28.472883 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:54:28.472883 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:54:28.472883 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:54:28.472883 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:54:28.472883 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:54:28.472883 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:54:28.472883 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50cd167f-2d4b-4f6e-91f4-9d768c3385d7 could not be found. Sep 06 22:54:28.472883 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:54:28.472883 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:54:28.472883 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:54:28.472883 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:54:28.472883 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:54:28.472883 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:54:28.472883 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:54:28.472883 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:54:28.472883 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:54:28.475181 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:54:28.475181 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 22:54:28.475181 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 22:54:28.475181 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:54:28.475181 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:54:28.475181 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:54:28.475181 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:54:28.475181 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50cd167f-2d4b-4f6e-91f4-9d768c3385d7 could not be found. Sep 06 22:54:28.475181 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:54:28.475181 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:54:28.475181 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:54:28.475181 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:54:28.475181 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:54:28.475181 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:54:28.475181 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:54:28.475181 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:54:28.475181 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50cd167f-2d4b-4f6e-91f4-9d768c3385d7 could not be found. Sep 06 22:54:28.475181 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:54:28.477324 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-8d6840e0-dd3b-4a6e-aff6-c3dac41801c7 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Returning 404 to user: Instance 50cd167f-2d4b-4f6e-91f4-9d768c3385d7 could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:54:28.477324 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-8d6840e0-dd3b-4a6e-aff6-c3dac41801c7 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7" status: 404 len: 111 microversion: 2.1 time: 0.031334 Sep 06 22:54:28.477324 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 524/1041] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:54:28 2022] GET /compute/v2.1/servers/50cd167f-2d4b-4f6e-91f4-9d768c3385d7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 22:54:29.610625 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a4571e28-05aa-47d4-a637-32aedb76d251 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:54:29.611108 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a4571e28-05aa-47d4-a637-32aedb76d251 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: dcccaffa-49b8-4d3f-b87d-c23204988c91] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:54:29.617511 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a4571e28-05aa-47d4-a637-32aedb76d251 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:54:29.617986 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a4571e28-05aa-47d4-a637-32aedb76d251 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:54:29.618415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a4571e28-05aa-47d4-a637-32aedb76d251 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:54:29.619097 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a4571e28-05aa-47d4-a637-32aedb76d251 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:54:29.619545 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a4571e28-05aa-47d4-a637-32aedb76d251 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:54:29.619968 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a4571e28-05aa-47d4-a637-32aedb76d251 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:54:29.636554 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-a4571e28-05aa-47d4-a637-32aedb76d251 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] HTTP exception thrown: Instance dcccaffa-49b8-4d3f-b87d-c23204988c91 could not be found. Sep 06 22:54:29.638121 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a4571e28-05aa-47d4-a637-32aedb76d251 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Request method failure captured: Sep 06 22:54:29.638121 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: request: DELETE /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91 HTTP/1.1 Sep 06 22:54:29.638121 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept: application/json Sep 06 22:54:29.638121 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Sep 06 22:54:29.638121 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Connection: close Sep 06 22:54:29.638121 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Length: 0 Sep 06 22:54:29.638121 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Type: application/json Sep 06 22:54:29.638121 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Host: 10.222.0.39 Sep 06 22:54:29.638121 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Sep 06 22:54:29.638121 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Sep 06 22:54:29.638121 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjF860yKGQSLzL5EmeXxXOacXOJOW7YjEJzU9q80MmpLf3abcjPgkwkUPc6JOe1BRsM08337WKjAQrMm7AibqPFxmuyJrmgvNBRnHTPCa8PNxKU8dZ5zs6S9shebBFRqMGenCSLIg7DtQDL1gVEhFL4BINUiinxCv43fRbm7ipIKDFqDQ Sep 06 22:54:29.638121 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Sep 06 22:54:29.638121 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Sep 06 22:54:29.638121 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Sep 06 22:54:29.638121 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Sep 06 22:54:29.638121 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Sep 06 22:54:29.638121 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Sep 06 22:54:29.638121 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Id: 121c13a143f447a1822f8df04b1a31a5 Sep 06 22:54:29.638121 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:54:29.638121 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Role: reader,member Sep 06 22:54:29.638121 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Sep 06 22:54:29.639666 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/121c13a143f447a1822f8df04b1a31a5"}]}] Sep 06 22:54:29.639666 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:54:29.639666 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 121c13a143f447a1822f8df04b1a31a5 Sep 06 22:54:29.639666 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:54:29.639666 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeNegativeTest-983971359-project Sep 06 22:54:29.639666 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Sep 06 22:54:29.639666 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Sep 06 22:54:29.639666 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Id: 68515ffe51b74aacb09e8584346e6db3 Sep 06 22:54:29.639666 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeNegativeTest-983971359-project Sep 06 22:54:29.639666 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: method: > Sep 06 22:54:29.639666 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: exception: Instance dcccaffa-49b8-4d3f-b87d-c23204988c91 could not be found. Sep 06 22:54:29.639666 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: action_args: {'id': 'dcccaffa-49b8-4d3f-b87d-c23204988c91'} Sep 06 22:54:29.640597 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:54:29.640597 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:54:29.640597 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:54:29.640597 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:54:29.640597 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:54:29.640597 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:54:29.640597 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:54:29.640597 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:54:29.640597 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:54:29.640597 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:54:29.640597 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcccaffa-49b8-4d3f-b87d-c23204988c91 could not be found. Sep 06 22:54:29.640597 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:54:29.640597 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:54:29.640597 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:54:29.640597 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:54:29.640597 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:54:29.640597 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:54:29.640597 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:54:29.640597 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:54:29.640597 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:54:29.642108 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:54:29.642108 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 22:54:29.642108 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 22:54:29.642108 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 22:54:29.642108 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 22:54:29.642108 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:54:29.642108 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:54:29.642108 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:54:29.642108 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:54:29.642108 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcccaffa-49b8-4d3f-b87d-c23204988c91 could not be found. Sep 06 22:54:29.642108 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:54:29.642108 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:54:29.642108 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:54:29.642108 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:54:29.642108 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:54:29.642108 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:54:29.642108 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:54:29.642108 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:54:29.642108 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcccaffa-49b8-4d3f-b87d-c23204988c91 could not be found. Sep 06 22:54:29.642108 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:54:29.643869 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a4571e28-05aa-47d4-a637-32aedb76d251 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Returning 404 to user: Instance dcccaffa-49b8-4d3f-b87d-c23204988c91 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:54:29.643869 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a4571e28-05aa-47d4-a637-32aedb76d251 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "DELETE /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91" status: 404 len: 111 microversion: 2.1 time: 0.032714 Sep 06 22:54:29.643869 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 518/1042] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Sep 6 22:54:29 2022] DELETE /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 22:54:29.648527 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-73ae7a80-5cb0-472c-93a1-95934848aa9c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:54:29.649162 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-73ae7a80-5cb0-472c-93a1-95934848aa9c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: dcccaffa-49b8-4d3f-b87d-c23204988c91] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:54:29.655776 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-73ae7a80-5cb0-472c-93a1-95934848aa9c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:54:29.656250 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-73ae7a80-5cb0-472c-93a1-95934848aa9c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:54:29.656965 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-73ae7a80-5cb0-472c-93a1-95934848aa9c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:54:29.663416 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-73ae7a80-5cb0-472c-93a1-95934848aa9c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:54:29.664463 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-73ae7a80-5cb0-472c-93a1-95934848aa9c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:54:29.665030 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-73ae7a80-5cb0-472c-93a1-95934848aa9c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:54:29.678910 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-73ae7a80-5cb0-472c-93a1-95934848aa9c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] HTTP exception thrown: Instance dcccaffa-49b8-4d3f-b87d-c23204988c91 could not be found. Sep 06 22:54:29.680428 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-73ae7a80-5cb0-472c-93a1-95934848aa9c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Request method failure captured: Sep 06 22:54:29.680428 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: request: GET /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91 HTTP/1.1 Sep 06 22:54:29.680428 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept: application/json Sep 06 22:54:29.680428 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Sep 06 22:54:29.680428 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Connection: close Sep 06 22:54:29.680428 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Length: 0 Sep 06 22:54:29.680428 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Type: application/json Sep 06 22:54:29.680428 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Host: 10.222.0.39 Sep 06 22:54:29.680428 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Sep 06 22:54:29.680428 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.12 Sep 06 22:54:29.680428 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABjF860yKGQSLzL5EmeXxXOacXOJOW7YjEJzU9q80MmpLf3abcjPgkwkUPc6JOe1BRsM08337WKjAQrMm7AibqPFxmuyJrmgvNBRnHTPCa8PNxKU8dZ5zs6S9shebBFRqMGenCSLIg7DtQDL1gVEhFL4BINUiinxCv43fRbm7ipIKDFqDQ Sep 06 22:54:29.680428 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Sep 06 22:54:29.680428 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Sep 06 22:54:29.680428 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Sep 06 22:54:29.680428 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Sep 06 22:54:29.680428 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Sep 06 22:54:29.680428 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Sep 06 22:54:29.680428 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Id: 121c13a143f447a1822f8df04b1a31a5 Sep 06 22:54:29.680428 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:54:29.680428 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Role: reader,member Sep 06 22:54:29.680428 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Sep 06 22:54:29.681992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/121c13a143f447a1822f8df04b1a31a5"}]}] Sep 06 22:54:29.681992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:54:29.681992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 121c13a143f447a1822f8df04b1a31a5 Sep 06 22:54:29.681992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:54:29.681992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User: tempest-AttachVolumeNegativeTest-983971359-project Sep 06 22:54:29.681992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Sep 06 22:54:29.681992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Sep 06 22:54:29.681992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Id: 68515ffe51b74aacb09e8584346e6db3 Sep 06 22:54:29.681992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-AttachVolumeNegativeTest-983971359-project Sep 06 22:54:29.681992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: method: > Sep 06 22:54:29.681992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: exception: Instance dcccaffa-49b8-4d3f-b87d-c23204988c91 could not be found. Sep 06 22:54:29.681992 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: action_args: {'id': 'dcccaffa-49b8-4d3f-b87d-c23204988c91'} Sep 06 22:54:29.683652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:54:29.683652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:54:29.683652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:54:29.683652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:54:29.683652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:54:29.683652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:54:29.683652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:54:29.683652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:54:29.683652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:54:29.683652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:54:29.683652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcccaffa-49b8-4d3f-b87d-c23204988c91 could not be found. Sep 06 22:54:29.683652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:54:29.683652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:54:29.683652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:54:29.683652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:54:29.683652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:54:29.683652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:54:29.683652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:54:29.683652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:54:29.683652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:54:29.685342 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:54:29.685342 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 22:54:29.685342 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 22:54:29.685342 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:54:29.685342 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:54:29.685342 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:54:29.685342 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:54:29.685342 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcccaffa-49b8-4d3f-b87d-c23204988c91 could not be found. Sep 06 22:54:29.685342 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:54:29.685342 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:54:29.685342 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:54:29.685342 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:54:29.685342 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:54:29.685342 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:54:29.685342 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:54:29.685342 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:54:29.685342 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcccaffa-49b8-4d3f-b87d-c23204988c91 could not be found. Sep 06 22:54:29.685342 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:54:29.686686 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-73ae7a80-5cb0-472c-93a1-95934848aa9c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Returning 404 to user: Instance dcccaffa-49b8-4d3f-b87d-c23204988c91 could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:54:29.686686 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-73ae7a80-5cb0-472c-93a1-95934848aa9c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91" status: 404 len: 111 microversion: 2.1 time: 0.037162 Sep 06 22:54:29.686686 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 525/1043] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:54:29 2022] GET /compute/v2.1/servers/dcccaffa-49b8-4d3f-b87d-c23204988c91 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 22:54:29.691475 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9fe7c576-8b24-4b4d-8e25-fac6c2bff911 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:54:29.692020 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9fe7c576-8b24-4b4d-8e25-fac6c2bff911 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:54:29.697905 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9fe7c576-8b24-4b4d-8e25-fac6c2bff911 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:54:29.698591 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9fe7c576-8b24-4b4d-8e25-fac6c2bff911 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:54:29.699433 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9fe7c576-8b24-4b4d-8e25-fac6c2bff911 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:54:29.700121 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9fe7c576-8b24-4b4d-8e25-fac6c2bff911 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:54:29.700573 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9fe7c576-8b24-4b4d-8e25-fac6c2bff911 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:54:29.701023 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9fe7c576-8b24-4b4d-8e25-fac6c2bff911 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:54:29.718853 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-9fe7c576-8b24-4b4d-8e25-fac6c2bff911 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] HTTP exception thrown: Instance 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc could not be found. Sep 06 22:54:29.720380 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9fe7c576-8b24-4b4d-8e25-fac6c2bff911 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Request method failure captured: Sep 06 22:54:29.720380 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: request: DELETE /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc HTTP/1.1 Sep 06 22:54:29.720380 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept: application/json Sep 06 22:54:29.720380 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Sep 06 22:54:29.720380 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Connection: close Sep 06 22:54:29.720380 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Length: 0 Sep 06 22:54:29.720380 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Type: application/json Sep 06 22:54:29.720380 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Host: 10.222.0.39 Sep 06 22:54:29.720380 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Sep 06 22:54:29.720380 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Sep 06 22:54:29.720380 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjF860yKGQSLzL5EmeXxXOacXOJOW7YjEJzU9q80MmpLf3abcjPgkwkUPc6JOe1BRsM08337WKjAQrMm7AibqPFxmuyJrmgvNBRnHTPCa8PNxKU8dZ5zs6S9shebBFRqMGenCSLIg7DtQDL1gVEhFL4BINUiinxCv43fRbm7ipIKDFqDQ Sep 06 22:54:29.720380 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Sep 06 22:54:29.720380 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Sep 06 22:54:29.720380 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Sep 06 22:54:29.720380 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Sep 06 22:54:29.720380 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Sep 06 22:54:29.720380 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Sep 06 22:54:29.720380 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Id: 121c13a143f447a1822f8df04b1a31a5 Sep 06 22:54:29.720380 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:54:29.720380 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Role: reader,member Sep 06 22:54:29.720380 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Sep 06 22:54:29.721964 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/121c13a143f447a1822f8df04b1a31a5"}]}] Sep 06 22:54:29.721964 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:54:29.721964 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 121c13a143f447a1822f8df04b1a31a5 Sep 06 22:54:29.721964 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:54:29.721964 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeNegativeTest-983971359-project Sep 06 22:54:29.721964 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Sep 06 22:54:29.721964 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Sep 06 22:54:29.721964 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Id: 68515ffe51b74aacb09e8584346e6db3 Sep 06 22:54:29.721964 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeNegativeTest-983971359-project Sep 06 22:54:29.721964 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: method: > Sep 06 22:54:29.721964 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: exception: Instance 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc could not be found. Sep 06 22:54:29.721964 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: action_args: {'id': '60e1fda2-c9b3-48ff-a9f5-18ce551b70dc'} Sep 06 22:54:29.722890 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:54:29.722890 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:54:29.722890 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:54:29.722890 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:54:29.722890 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:54:29.722890 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:54:29.722890 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:54:29.722890 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:54:29.722890 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:54:29.722890 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:54:29.722890 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc could not be found. Sep 06 22:54:29.722890 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:54:29.722890 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:54:29.722890 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:54:29.722890 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:54:29.722890 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:54:29.722890 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:54:29.722890 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:54:29.722890 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:54:29.722890 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:54:29.724361 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:54:29.724361 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 22:54:29.724361 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 22:54:29.724361 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 22:54:29.724361 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 22:54:29.724361 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:54:29.724361 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:54:29.724361 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:54:29.724361 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:54:29.724361 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc could not be found. Sep 06 22:54:29.724361 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:54:29.724361 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:54:29.724361 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:54:29.724361 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:54:29.724361 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:54:29.724361 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:54:29.724361 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:54:29.724361 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:54:29.724361 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc could not be found. Sep 06 22:54:29.724361 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:54:29.725875 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9fe7c576-8b24-4b4d-8e25-fac6c2bff911 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Returning 404 to user: Instance 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:54:29.725875 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9fe7c576-8b24-4b4d-8e25-fac6c2bff911 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "DELETE /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc" status: 404 len: 111 microversion: 2.1 time: 0.034174 Sep 06 22:54:29.725875 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 519/1044] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Sep 6 22:54:29 2022] DELETE /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 22:54:29.730847 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-fee609fd-f892-4ff3-9edd-11c53ed5e3ac tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:54:29.731476 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-fee609fd-f892-4ff3-9edd-11c53ed5e3ac tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:54:29.737330 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fee609fd-f892-4ff3-9edd-11c53ed5e3ac tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:54:29.737794 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fee609fd-f892-4ff3-9edd-11c53ed5e3ac tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:54:29.738212 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fee609fd-f892-4ff3-9edd-11c53ed5e3ac tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:54:29.738881 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fee609fd-f892-4ff3-9edd-11c53ed5e3ac tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:54:29.739319 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fee609fd-f892-4ff3-9edd-11c53ed5e3ac tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:54:29.739729 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-fee609fd-f892-4ff3-9edd-11c53ed5e3ac tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:54:29.753094 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-fee609fd-f892-4ff3-9edd-11c53ed5e3ac tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] HTTP exception thrown: Instance 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc could not be found. Sep 06 22:54:29.754570 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-fee609fd-f892-4ff3-9edd-11c53ed5e3ac tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Request method failure captured: Sep 06 22:54:29.754570 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: request: GET /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc HTTP/1.1 Sep 06 22:54:29.754570 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept: application/json Sep 06 22:54:29.754570 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Sep 06 22:54:29.754570 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Connection: close Sep 06 22:54:29.754570 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Length: 0 Sep 06 22:54:29.754570 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Type: application/json Sep 06 22:54:29.754570 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Host: 10.222.0.39 Sep 06 22:54:29.754570 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Sep 06 22:54:29.754570 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.12 Sep 06 22:54:29.754570 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABjF860yKGQSLzL5EmeXxXOacXOJOW7YjEJzU9q80MmpLf3abcjPgkwkUPc6JOe1BRsM08337WKjAQrMm7AibqPFxmuyJrmgvNBRnHTPCa8PNxKU8dZ5zs6S9shebBFRqMGenCSLIg7DtQDL1gVEhFL4BINUiinxCv43fRbm7ipIKDFqDQ Sep 06 22:54:29.754570 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Sep 06 22:54:29.754570 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Sep 06 22:54:29.754570 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Sep 06 22:54:29.754570 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Sep 06 22:54:29.754570 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Sep 06 22:54:29.754570 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Sep 06 22:54:29.754570 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Id: 121c13a143f447a1822f8df04b1a31a5 Sep 06 22:54:29.754570 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:54:29.754570 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Role: reader,member Sep 06 22:54:29.754570 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Sep 06 22:54:29.756145 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/121c13a143f447a1822f8df04b1a31a5"}]}] Sep 06 22:54:29.756145 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:54:29.756145 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 121c13a143f447a1822f8df04b1a31a5 Sep 06 22:54:29.756145 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:54:29.756145 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User: tempest-AttachVolumeNegativeTest-983971359-project Sep 06 22:54:29.756145 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Sep 06 22:54:29.756145 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Sep 06 22:54:29.756145 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Id: 68515ffe51b74aacb09e8584346e6db3 Sep 06 22:54:29.756145 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-AttachVolumeNegativeTest-983971359-project Sep 06 22:54:29.756145 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: method: > Sep 06 22:54:29.756145 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: exception: Instance 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc could not be found. Sep 06 22:54:29.756145 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: action_args: {'id': '60e1fda2-c9b3-48ff-a9f5-18ce551b70dc'} Sep 06 22:54:29.757033 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:54:29.757033 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:54:29.757033 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:54:29.757033 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:54:29.757033 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:54:29.757033 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:54:29.757033 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:54:29.757033 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:54:29.757033 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:54:29.757033 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:54:29.757033 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc could not be found. Sep 06 22:54:29.757033 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:54:29.757033 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:54:29.757033 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:54:29.757033 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:54:29.757033 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:54:29.757033 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:54:29.757033 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:54:29.757033 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:54:29.757033 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:54:29.758258 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:54:29.758258 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 22:54:29.758258 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 22:54:29.758258 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:54:29.758258 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:54:29.758258 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:54:29.758258 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:54:29.758258 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc could not be found. Sep 06 22:54:29.758258 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:54:29.758258 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:54:29.758258 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:54:29.758258 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:54:29.758258 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:54:29.758258 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:54:29.758258 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:54:29.758258 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:54:29.758258 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc could not be found. Sep 06 22:54:29.758258 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:54:29.762678 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-fee609fd-f892-4ff3-9edd-11c53ed5e3ac tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Returning 404 to user: Instance 60e1fda2-c9b3-48ff-a9f5-18ce551b70dc could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:54:29.762678 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-fee609fd-f892-4ff3-9edd-11c53ed5e3ac tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc" status: 404 len: 111 microversion: 2.1 time: 0.029474 Sep 06 22:54:29.762678 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 526/1045] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:54:29 2022] GET /compute/v2.1/servers/60e1fda2-c9b3-48ff-a9f5-18ce551b70dc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 22:54:30.893460 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fae9e5ed-91bf-427b-90d7-464a293a8b99 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:54:30.893975 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-fae9e5ed-91bf-427b-90d7-464a293a8b99 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: a55ba753-4ee6-4731-b85e-ea1bc484bc97] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:54:30.900197 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fae9e5ed-91bf-427b-90d7-464a293a8b99 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:54:30.900681 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fae9e5ed-91bf-427b-90d7-464a293a8b99 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:54:30.901145 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fae9e5ed-91bf-427b-90d7-464a293a8b99 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:54:30.901827 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fae9e5ed-91bf-427b-90d7-464a293a8b99 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:54:30.902276 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fae9e5ed-91bf-427b-90d7-464a293a8b99 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:54:30.903653 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-fae9e5ed-91bf-427b-90d7-464a293a8b99 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:54:30.916998 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.wsgi [None req-fae9e5ed-91bf-427b-90d7-464a293a8b99 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] HTTP exception thrown: Instance a55ba753-4ee6-4731-b85e-ea1bc484bc97 could not be found. Sep 06 22:54:30.919639 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fae9e5ed-91bf-427b-90d7-464a293a8b99 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Request method failure captured: Sep 06 22:54:30.919639 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: request: DELETE /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97 HTTP/1.1 Sep 06 22:54:30.919639 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept: application/json Sep 06 22:54:30.919639 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Accept-Encoding: identity Sep 06 22:54:30.919639 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Connection: close Sep 06 22:54:30.919639 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Length: 0 Sep 06 22:54:30.919639 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Content-Type: application/json Sep 06 22:54:30.919639 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Host: 10.222.0.39 Sep 06 22:54:30.919639 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Openstack-System-Scope: None Sep 06 22:54:30.919639 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: User-Agent: python-urllib3/1.26.12 Sep 06 22:54:30.919639 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Auth-Token: gAAAAABjF860yKGQSLzL5EmeXxXOacXOJOW7YjEJzU9q80MmpLf3abcjPgkwkUPc6JOe1BRsM08337WKjAQrMm7AibqPFxmuyJrmgvNBRnHTPCa8PNxKU8dZ5zs6S9shebBFRqMGenCSLIg7DtQDL1gVEhFL4BINUiinxCv43fRbm7ipIKDFqDQ Sep 06 22:54:30.919639 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Id: None Sep 06 22:54:30.919639 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Domain-Name: None Sep 06 22:54:30.919639 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Identity-Status: Confirmed Sep 06 22:54:30.919639 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Is-Admin-Project: True Sep 06 22:54:30.919639 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Id: default Sep 06 22:54:30.919639 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Domain-Name: Default Sep 06 22:54:30.919639 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Id: 121c13a143f447a1822f8df04b1a31a5 Sep 06 22:54:30.919639 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Project-Name: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:54:30.919639 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Role: reader,member Sep 06 22:54:30.919639 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Roles: reader,member Sep 06 22:54:30.921334 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/121c13a143f447a1822f8df04b1a31a5"}]}] Sep 06 22:54:30.921334 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:54:30.921334 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Id: 121c13a143f447a1822f8df04b1a31a5 Sep 06 22:54:30.921334 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:54:30.921334 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User: tempest-AttachVolumeNegativeTest-983971359-project Sep 06 22:54:30.921334 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Id: default Sep 06 22:54:30.921334 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Domain-Name: Default Sep 06 22:54:30.921334 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Id: 68515ffe51b74aacb09e8584346e6db3 Sep 06 22:54:30.921334 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: X-User-Name: tempest-AttachVolumeNegativeTest-983971359-project Sep 06 22:54:30.921334 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: method: > Sep 06 22:54:30.921334 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: exception: Instance a55ba753-4ee6-4731-b85e-ea1bc484bc97 could not be found. Sep 06 22:54:30.921334 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: action_args: {'id': 'a55ba753-4ee6-4731-b85e-ea1bc484bc97'} Sep 06 22:54:30.922304 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:54:30.922304 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:54:30.922304 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:54:30.922304 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:54:30.922304 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:54:30.922304 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:54:30.922304 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:54:30.922304 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:54:30.922304 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:54:30.922304 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:54:30.922304 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a55ba753-4ee6-4731-b85e-ea1bc484bc97 could not be found. Sep 06 22:54:30.922304 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:54:30.922304 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:54:30.922304 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:54:30.922304 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:54:30.922304 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:54:30.922304 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:54:30.922304 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:54:30.922304 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:54:30.922304 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:54:30.923647 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:54:30.923647 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 22:54:30.923647 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 22:54:30.923647 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 22:54:30.923647 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 22:54:30.923647 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:54:30.923647 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:54:30.923647 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:54:30.923647 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:54:30.923647 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a55ba753-4ee6-4731-b85e-ea1bc484bc97 could not be found. Sep 06 22:54:30.923647 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:54:30.923647 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:54:30.923647 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:54:30.923647 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:54:30.923647 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:54:30.923647 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:54:30.923647 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:54:30.923647 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:54:30.923647 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a55ba753-4ee6-4731-b85e-ea1bc484bc97 could not be found. Sep 06 22:54:30.923647 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: ERROR nova.api.openstack.wsgi Sep 06 22:54:30.925129 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-fae9e5ed-91bf-427b-90d7-464a293a8b99 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Returning 404 to user: Instance a55ba753-4ee6-4731-b85e-ea1bc484bc97 could not be found. {{(pid=127088) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:54:30.925129 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-fae9e5ed-91bf-427b-90d7-464a293a8b99 tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97" status: 404 len: 111 microversion: 2.1 time: 0.031570 Sep 06 22:54:30.925129 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 520/1046] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Sep 6 22:54:30 2022] DELETE /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 22:54:30.929477 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-364dd4cb-3a38-464b-8764-55347e24da4c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:54:30.930088 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-364dd4cb-3a38-464b-8764-55347e24da4c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] [instance: a55ba753-4ee6-4731-b85e-ea1bc484bc97] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:54:30.936687 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-364dd4cb-3a38-464b-8764-55347e24da4c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:54:30.937198 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-364dd4cb-3a38-464b-8764-55347e24da4c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:54:30.937621 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-364dd4cb-3a38-464b-8764-55347e24da4c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:54:30.938299 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-364dd4cb-3a38-464b-8764-55347e24da4c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:54:30.938745 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-364dd4cb-3a38-464b-8764-55347e24da4c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:54:30.939159 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-364dd4cb-3a38-464b-8764-55347e24da4c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:54:30.954448 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-364dd4cb-3a38-464b-8764-55347e24da4c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] HTTP exception thrown: Instance a55ba753-4ee6-4731-b85e-ea1bc484bc97 could not be found. Sep 06 22:54:30.955950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-364dd4cb-3a38-464b-8764-55347e24da4c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Request method failure captured: Sep 06 22:54:30.955950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: request: GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97 HTTP/1.1 Sep 06 22:54:30.955950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept: application/json Sep 06 22:54:30.955950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Sep 06 22:54:30.955950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Connection: close Sep 06 22:54:30.955950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Length: 0 Sep 06 22:54:30.955950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Type: application/json Sep 06 22:54:30.955950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Host: 10.222.0.39 Sep 06 22:54:30.955950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Sep 06 22:54:30.955950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.12 Sep 06 22:54:30.955950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABjF860yKGQSLzL5EmeXxXOacXOJOW7YjEJzU9q80MmpLf3abcjPgkwkUPc6JOe1BRsM08337WKjAQrMm7AibqPFxmuyJrmgvNBRnHTPCa8PNxKU8dZ5zs6S9shebBFRqMGenCSLIg7DtQDL1gVEhFL4BINUiinxCv43fRbm7ipIKDFqDQ Sep 06 22:54:30.955950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Sep 06 22:54:30.955950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Sep 06 22:54:30.955950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Sep 06 22:54:30.955950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Sep 06 22:54:30.955950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Sep 06 22:54:30.955950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Sep 06 22:54:30.955950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Id: 121c13a143f447a1822f8df04b1a31a5 Sep 06 22:54:30.955950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:54:30.955950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Role: reader,member Sep 06 22:54:30.955950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Sep 06 22:54:30.957698 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/121c13a143f447a1822f8df04b1a31a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/121c13a143f447a1822f8df04b1a31a5"}]}] Sep 06 22:54:30.957698 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:54:30.957698 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 121c13a143f447a1822f8df04b1a31a5 Sep 06 22:54:30.957698 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-983971359 Sep 06 22:54:30.957698 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User: tempest-AttachVolumeNegativeTest-983971359-project Sep 06 22:54:30.957698 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Sep 06 22:54:30.957698 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Sep 06 22:54:30.957698 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Id: 68515ffe51b74aacb09e8584346e6db3 Sep 06 22:54:30.957698 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-AttachVolumeNegativeTest-983971359-project Sep 06 22:54:30.957698 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: method: > Sep 06 22:54:30.957698 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: exception: Instance a55ba753-4ee6-4731-b85e-ea1bc484bc97 could not be found. Sep 06 22:54:30.957698 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: action_args: {'id': 'a55ba753-4ee6-4731-b85e-ea1bc484bc97'} Sep 06 22:54:30.958870 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:54:30.958870 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:54:30.958870 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:54:30.958870 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:54:30.958870 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:54:30.958870 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:54:30.958870 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:54:30.958870 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:54:30.958870 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:54:30.958870 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:54:30.958870 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a55ba753-4ee6-4731-b85e-ea1bc484bc97 could not be found. Sep 06 22:54:30.958870 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:54:30.958870 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:54:30.958870 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:54:30.958870 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:54:30.958870 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:54:30.958870 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:54:30.958870 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:54:30.958870 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:54:30.958870 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:54:30.960379 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:54:30.960379 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 22:54:30.960379 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 22:54:30.960379 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:54:30.960379 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:54:30.960379 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:54:30.960379 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:54:30.960379 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a55ba753-4ee6-4731-b85e-ea1bc484bc97 could not be found. Sep 06 22:54:30.960379 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:54:30.960379 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:54:30.960379 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:54:30.960379 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:54:30.960379 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:54:30.960379 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:54:30.960379 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:54:30.960379 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:54:30.960379 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a55ba753-4ee6-4731-b85e-ea1bc484bc97 could not be found. Sep 06 22:54:30.960379 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:54:30.961834 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-364dd4cb-3a38-464b-8764-55347e24da4c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] Returning 404 to user: Instance a55ba753-4ee6-4731-b85e-ea1bc484bc97 could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:54:30.961834 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-364dd4cb-3a38-464b-8764-55347e24da4c tempest-AttachVolumeNegativeTest-983971359 tempest-AttachVolumeNegativeTest-983971359-project] 10.222.0.39 "GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97" status: 404 len: 111 microversion: 2.1 time: 0.031664 Sep 06 22:54:30.961834 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 527/1047] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:54:30 2022] GET /compute/v2.1/servers/a55ba753-4ee6-4731-b85e-ea1bc484bc97 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 22:55:34.124748 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=20 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:55:34.125514 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=37,nova_cell1:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:55:34.130354 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-80dd9766-31ad-40c3-8914-82405f274d04 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Action: 'create', calling method: .version_select at 0x7f9c4f61d9d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-109505324", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKGmfjwIxcG7fGq0FmeuwPDXbHD8oIMgj0Gh7eEruY3bwfpNS0apwynvMKhmgsL2y0ualpEamAjZSsfYaRC9QdHd3E2e+MRcBKCNyTSn9rIbgER4qycOU7Uoo3IXknNvA=="}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:55:34.147794 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-80dd9766-31ad-40c3-8914-82405f274d04 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Getting quotas for project 9b9a2326d5c84ea8bcfc43d1ec1f1908. Resources: {'key_pairs'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 22:55:34.151771 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.quota [None req-80dd9766-31ad-40c3-8914-82405f274d04 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Getting quotas for user 8dbf669e41524ef6a696bef77dab7080 and project 9b9a2326d5c84ea8bcfc43d1ec1f1908. Resources: {'key_pairs'} {{(pid=127088) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 22:55:34.173561 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-80dd9766-31ad-40c3-8914-82405f274d04 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.050608 Sep 06 22:55:34.174152 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 521/1048] 10.222.0.39 () {60 vars in 1159 bytes} [Tue Sep 6 22:55:34 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:55:34.223369 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:55:34.224104 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:55:34.228531 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-728dddd2-a11e-4fc7-ad40-fc094693f9c2 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1247914527", "imageRef": "99d6a365-56c5-479b-9d88-c978fe4a6198", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-109505324", "networks": [{"uuid": "ed5aae24-d353-4f48-b53f-74ce440cbde8"}]}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:55:34.293908 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.network.neutron [None req-728dddd2-a11e-4fc7-ad40-fc094693f9c2 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] validate_networks() for [('ed5aae24-d353-4f48-b53f-74ce440cbde8', None, None, None, None, None)] {{(pid=127087) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 22:55:35.039105 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-728dddd2-a11e-4fc7-ad40-fc094693f9c2 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Flavor limits 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 22:55:35.039507 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-728dddd2-a11e-4fc7-ad40-fc094693f9c2 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Image limits 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 22:55:35.039964 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-728dddd2-a11e-4fc7-ad40-fc094693f9c2 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Flavor pref 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 22:55:35.040384 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-728dddd2-a11e-4fc7-ad40-fc094693f9c2 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Image pref 0:0:0 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 22:55:35.040800 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.virt.hardware [None req-728dddd2-a11e-4fc7-ad40-fc094693f9c2 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127087) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 22:55:35.049989 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-728dddd2-a11e-4fc7-ad40-fc094693f9c2 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:35.050454 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-728dddd2-a11e-4fc7-ad40-fc094693f9c2 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:35.050869 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-728dddd2-a11e-4fc7-ad40-fc094693f9c2 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:35.051605 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-728dddd2-a11e-4fc7-ad40-fc094693f9c2 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:35.052042 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-728dddd2-a11e-4fc7-ad40-fc094693f9c2 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:35.052450 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-728dddd2-a11e-4fc7-ad40-fc094693f9c2 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:35.069550 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-728dddd2-a11e-4fc7-ad40-fc094693f9c2 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Getting quotas for project 9b9a2326d5c84ea8bcfc43d1ec1f1908. Resources: {'instances', 'ram', 'cores'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 22:55:35.073429 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.quota [None req-728dddd2-a11e-4fc7-ad40-fc094693f9c2 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Getting quotas for user 8dbf669e41524ef6a696bef77dab7080 and project 9b9a2326d5c84ea8bcfc43d1ec1f1908. Resources: {'instances', 'ram', 'cores'} {{(pid=127087) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 22:55:35.084179 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-728dddd2-a11e-4fc7-ad40-fc094693f9c2 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Going to run 1 instances... {{(pid=127087) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 22:55:35.086355 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-728dddd2-a11e-4fc7-ad40-fc094693f9c2 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='99d6a365-56c5-479b-9d88-c978fe4a6198',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127087) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 22:55:35.129810 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR oslo.messaging._drivers.impl_rabbit [None req-728dddd2-a11e-4fc7-ad40-fc094693f9c2 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [3ec795e8-58af-4b13-be0a-c157a47f0575] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 06 22:55:36.138563 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO oslo.messaging._drivers.impl_rabbit [None req-728dddd2-a11e-4fc7-ad40-fc094693f9c2 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [3ec795e8-58af-4b13-be0a-c157a47f0575] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 37846. Sep 06 22:55:36.142776 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-728dddd2-a11e-4fc7-ad40-fc094693f9c2 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.921357 Sep 06 22:55:36.143408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 528/1049] 10.222.0.39 () {60 vars in 1147 bytes} [Tue Sep 6 22:55:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 22:55:36.154918 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5661d423-23dd-4b92-9ea1-99a674584eb3 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:55:36.155531 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5661d423-23dd-4b92-9ea1-99a674584eb3 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:55:36.210743 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5661d423-23dd-4b92-9ea1-99a674584eb3 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbf669e41524ef6a696bef77dab7080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9a2326d5c84ea8bcfc43d1ec1f1908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:55:36.218829 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5661d423-23dd-4b92-9ea1-99a674584eb3 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35" status: 200 len: 1258 microversion: 2.1 time: 0.068494 Sep 06 22:55:36.219390 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 522/1050] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:55:36 2022] GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35 => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:55:37.242861 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-2e8ac904-dff6-47d9-a8d4-9f64ade11029 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:55:37.243399 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-2e8ac904-dff6-47d9-a8d4-9f64ade11029 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:55:37.251403 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2e8ac904-dff6-47d9-a8d4-9f64ade11029 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:37.252136 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2e8ac904-dff6-47d9-a8d4-9f64ade11029 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:37.252563 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2e8ac904-dff6-47d9-a8d4-9f64ade11029 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:37.253307 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2e8ac904-dff6-47d9-a8d4-9f64ade11029 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:37.253751 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2e8ac904-dff6-47d9-a8d4-9f64ade11029 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:37.254166 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-2e8ac904-dff6-47d9-a8d4-9f64ade11029 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:37.332322 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-2e8ac904-dff6-47d9-a8d4-9f64ade11029 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbf669e41524ef6a696bef77dab7080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9a2326d5c84ea8bcfc43d1ec1f1908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:55:37.341090 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-2e8ac904-dff6-47d9-a8d4-9f64ade11029 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35" status: 200 len: 1318 microversion: 2.1 time: 0.102703 Sep 06 22:55:37.341660 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 529/1051] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:55:37 2022] GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35 => generated 1318 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:55:38.363788 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-a86663f0-8707-4ff7-86c8-80a0726b0b79 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:55:38.364540 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-a86663f0-8707-4ff7-86c8-80a0726b0b79 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:55:38.375040 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a86663f0-8707-4ff7-86c8-80a0726b0b79 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:38.375538 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a86663f0-8707-4ff7-86c8-80a0726b0b79 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:38.375966 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a86663f0-8707-4ff7-86c8-80a0726b0b79 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:38.376668 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a86663f0-8707-4ff7-86c8-80a0726b0b79 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:38.381364 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a86663f0-8707-4ff7-86c8-80a0726b0b79 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:38.381841 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-a86663f0-8707-4ff7-86c8-80a0726b0b79 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:38.532164 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-a86663f0-8707-4ff7-86c8-80a0726b0b79 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbf669e41524ef6a696bef77dab7080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9a2326d5c84ea8bcfc43d1ec1f1908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:55:38.544584 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-a86663f0-8707-4ff7-86c8-80a0726b0b79 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35" status: 200 len: 1358 microversion: 2.1 time: 0.184793 Sep 06 22:55:38.545867 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 523/1052] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:55:38 2022] GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:55:39.568710 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6d04b096-b0ae-498c-b107-4777dbd8a168 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:55:39.569319 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-6d04b096-b0ae-498c-b107-4777dbd8a168 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:55:39.592289 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6d04b096-b0ae-498c-b107-4777dbd8a168 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:39.592815 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6d04b096-b0ae-498c-b107-4777dbd8a168 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:39.593262 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6d04b096-b0ae-498c-b107-4777dbd8a168 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:39.593978 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6d04b096-b0ae-498c-b107-4777dbd8a168 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:39.594430 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6d04b096-b0ae-498c-b107-4777dbd8a168 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:39.594851 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6d04b096-b0ae-498c-b107-4777dbd8a168 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:39.750729 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6d04b096-b0ae-498c-b107-4777dbd8a168 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbf669e41524ef6a696bef77dab7080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9a2326d5c84ea8bcfc43d1ec1f1908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:55:39.759126 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-6d04b096-b0ae-498c-b107-4777dbd8a168 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35" status: 200 len: 1358 microversion: 2.1 time: 0.194417 Sep 06 22:55:39.759941 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 530/1053] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:55:39 2022] GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:55:40.782996 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-faf73f49-7138-4074-877b-9dfcf103b78b tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:55:40.783610 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-faf73f49-7138-4074-877b-9dfcf103b78b tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:55:40.790149 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-faf73f49-7138-4074-877b-9dfcf103b78b tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:40.790627 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-faf73f49-7138-4074-877b-9dfcf103b78b tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:40.791052 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-faf73f49-7138-4074-877b-9dfcf103b78b tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:40.791742 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-faf73f49-7138-4074-877b-9dfcf103b78b tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:40.792193 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-faf73f49-7138-4074-877b-9dfcf103b78b tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:40.793237 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-faf73f49-7138-4074-877b-9dfcf103b78b tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:40.958809 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-faf73f49-7138-4074-877b-9dfcf103b78b tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbf669e41524ef6a696bef77dab7080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9a2326d5c84ea8bcfc43d1ec1f1908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:55:40.967405 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-faf73f49-7138-4074-877b-9dfcf103b78b tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35" status: 200 len: 1358 microversion: 2.1 time: 0.188357 Sep 06 22:55:40.968032 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 524/1054] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:55:40 2022] GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:55:41.989842 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-eae5146f-d911-427b-9268-a294c367508f tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:55:41.990443 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-eae5146f-d911-427b-9268-a294c367508f tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:55:41.998107 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-eae5146f-d911-427b-9268-a294c367508f tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:41.998735 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-eae5146f-d911-427b-9268-a294c367508f tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:41.999222 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-eae5146f-d911-427b-9268-a294c367508f tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:42.012822 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-eae5146f-d911-427b-9268-a294c367508f tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:42.013566 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-eae5146f-d911-427b-9268-a294c367508f tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:42.014016 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-eae5146f-d911-427b-9268-a294c367508f tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:42.166219 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-eae5146f-d911-427b-9268-a294c367508f tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbf669e41524ef6a696bef77dab7080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9a2326d5c84ea8bcfc43d1ec1f1908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:55:42.175494 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-eae5146f-d911-427b-9268-a294c367508f tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35" status: 200 len: 1358 microversion: 2.1 time: 0.189324 Sep 06 22:55:42.176150 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 531/1055] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:55:41 2022] GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:55:43.199617 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-56e3d6fe-df93-4bfd-a29e-a9eeecf41c87 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:55:43.200396 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-56e3d6fe-df93-4bfd-a29e-a9eeecf41c87 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:55:43.206740 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-56e3d6fe-df93-4bfd-a29e-a9eeecf41c87 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:43.207223 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-56e3d6fe-df93-4bfd-a29e-a9eeecf41c87 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:43.207676 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-56e3d6fe-df93-4bfd-a29e-a9eeecf41c87 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:43.208350 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-56e3d6fe-df93-4bfd-a29e-a9eeecf41c87 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:43.208854 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-56e3d6fe-df93-4bfd-a29e-a9eeecf41c87 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:43.209312 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-56e3d6fe-df93-4bfd-a29e-a9eeecf41c87 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:43.371010 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-56e3d6fe-df93-4bfd-a29e-a9eeecf41c87 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbf669e41524ef6a696bef77dab7080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9a2326d5c84ea8bcfc43d1ec1f1908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:55:43.380107 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-56e3d6fe-df93-4bfd-a29e-a9eeecf41c87 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35" status: 200 len: 1358 microversion: 2.1 time: 0.184989 Sep 06 22:55:43.380692 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 525/1056] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:55:43 2022] GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:55:44.403889 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-4b24cd33-dac2-4dee-9e21-891003072be4 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:55:44.405484 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-4b24cd33-dac2-4dee-9e21-891003072be4 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:55:44.413060 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4b24cd33-dac2-4dee-9e21-891003072be4 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:44.414201 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4b24cd33-dac2-4dee-9e21-891003072be4 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:44.415082 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4b24cd33-dac2-4dee-9e21-891003072be4 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:44.416029 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4b24cd33-dac2-4dee-9e21-891003072be4 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:44.416700 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4b24cd33-dac2-4dee-9e21-891003072be4 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:44.417327 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4b24cd33-dac2-4dee-9e21-891003072be4 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:44.563689 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-4b24cd33-dac2-4dee-9e21-891003072be4 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbf669e41524ef6a696bef77dab7080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9a2326d5c84ea8bcfc43d1ec1f1908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:55:44.572630 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-4b24cd33-dac2-4dee-9e21-891003072be4 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35" status: 200 len: 1358 microversion: 2.1 time: 0.172209 Sep 06 22:55:44.572630 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 532/1057] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:55:44 2022] GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:55:45.596415 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4148c305-a648-494a-bf96-18b18bc75d77 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:55:45.597381 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4148c305-a648-494a-bf96-18b18bc75d77 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:55:45.607271 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4148c305-a648-494a-bf96-18b18bc75d77 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:45.607989 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4148c305-a648-494a-bf96-18b18bc75d77 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:45.608630 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4148c305-a648-494a-bf96-18b18bc75d77 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:45.609761 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4148c305-a648-494a-bf96-18b18bc75d77 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:45.610372 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4148c305-a648-494a-bf96-18b18bc75d77 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:45.611003 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4148c305-a648-494a-bf96-18b18bc75d77 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:45.851364 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4148c305-a648-494a-bf96-18b18bc75d77 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbf669e41524ef6a696bef77dab7080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9a2326d5c84ea8bcfc43d1ec1f1908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:55:45.859828 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4148c305-a648-494a-bf96-18b18bc75d77 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35" status: 200 len: 1358 microversion: 2.1 time: 0.267905 Sep 06 22:55:45.860409 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 526/1058] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:55:45 2022] GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35 => generated 1358 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:55:45.998737 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-1c09bf37-ef48-436d-9c69-c568f6e78584 req-ffa173ef-284e-4522-ba35-bb4bd5ba8794 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "769031a7-c54b-4049-8faa-73ed46076c35", "tag": "1b6a0229-fbf1-4d69-b46b-a406a8ff714b"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:55:46.005326 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=2 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:55:46.006018 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell0:SELECT=6 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:55:46.013755 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-1c09bf37-ef48-436d-9c69-c568f6e78584 req-ffa173ef-284e-4522-ba35-bb4bd5ba8794 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:46.014332 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-1c09bf37-ef48-436d-9c69-c568f6e78584 req-ffa173ef-284e-4522-ba35-bb4bd5ba8794 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:46.014836 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-1c09bf37-ef48-436d-9c69-c568f6e78584 req-ffa173ef-284e-4522-ba35-bb4bd5ba8794 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:46.029017 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-1c09bf37-ef48-436d-9c69-c568f6e78584 req-ffa173ef-284e-4522-ba35-bb4bd5ba8794 service nova] Creating event network-changed:1b6a0229-fbf1-4d69-b46b-a406a8ff714b for instance 769031a7-c54b-4049-8faa-73ed46076c35 on hv-cinder-85220 Sep 06 22:55:46.034444 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-1c09bf37-ef48-436d-9c69-c568f6e78584 req-ffa173ef-284e-4522-ba35-bb4bd5ba8794 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039282 Sep 06 22:55:46.035046 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 533/1059] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:55:46.882890 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e708e68e-eddf-4095-b5e5-c57d2d8ecfa0 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:55:46.883418 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e708e68e-eddf-4095-b5e5-c57d2d8ecfa0 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:55:46.885254 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=6 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:55:46.891555 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e708e68e-eddf-4095-b5e5-c57d2d8ecfa0 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:46.892033 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e708e68e-eddf-4095-b5e5-c57d2d8ecfa0 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:46.892459 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e708e68e-eddf-4095-b5e5-c57d2d8ecfa0 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:46.893187 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e708e68e-eddf-4095-b5e5-c57d2d8ecfa0 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:46.893637 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e708e68e-eddf-4095-b5e5-c57d2d8ecfa0 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:46.894087 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e708e68e-eddf-4095-b5e5-c57d2d8ecfa0 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:47.026501 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e708e68e-eddf-4095-b5e5-c57d2d8ecfa0 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbf669e41524ef6a696bef77dab7080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9a2326d5c84ea8bcfc43d1ec1f1908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:55:47.034247 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e708e68e-eddf-4095-b5e5-c57d2d8ecfa0 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35" status: 200 len: 1358 microversion: 2.1 time: 0.155416 Sep 06 22:55:47.034808 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 527/1060] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:55:46 2022] GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:55:48.057535 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-c959a90e-210f-4e77-a11d-365c8ae55e66 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:55:48.058228 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-c959a90e-210f-4e77-a11d-365c8ae55e66 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:55:48.065025 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c959a90e-210f-4e77-a11d-365c8ae55e66 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:48.065500 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c959a90e-210f-4e77-a11d-365c8ae55e66 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:48.065929 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c959a90e-210f-4e77-a11d-365c8ae55e66 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:48.066608 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c959a90e-210f-4e77-a11d-365c8ae55e66 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:48.067053 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c959a90e-210f-4e77-a11d-365c8ae55e66 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:48.067472 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c959a90e-210f-4e77-a11d-365c8ae55e66 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:48.202690 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-c959a90e-210f-4e77-a11d-365c8ae55e66 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbf669e41524ef6a696bef77dab7080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9a2326d5c84ea8bcfc43d1ec1f1908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:55:48.210238 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-c959a90e-210f-4e77-a11d-365c8ae55e66 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35" status: 200 len: 1358 microversion: 2.1 time: 0.157409 Sep 06 22:55:48.210788 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 534/1061] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:55:48 2022] GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:55:49.232833 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0c91f1c8-f8e3-4a0b-bcda-608ce3bcf9e9 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:55:49.233442 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0c91f1c8-f8e3-4a0b-bcda-608ce3bcf9e9 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:55:49.239319 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0c91f1c8-f8e3-4a0b-bcda-608ce3bcf9e9 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:49.239795 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0c91f1c8-f8e3-4a0b-bcda-608ce3bcf9e9 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:49.240240 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0c91f1c8-f8e3-4a0b-bcda-608ce3bcf9e9 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:49.240933 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0c91f1c8-f8e3-4a0b-bcda-608ce3bcf9e9 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:49.241380 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0c91f1c8-f8e3-4a0b-bcda-608ce3bcf9e9 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:49.241798 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0c91f1c8-f8e3-4a0b-bcda-608ce3bcf9e9 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:49.382000 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-0c91f1c8-f8e3-4a0b-bcda-608ce3bcf9e9 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbf669e41524ef6a696bef77dab7080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9a2326d5c84ea8bcfc43d1ec1f1908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:55:49.389712 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0c91f1c8-f8e3-4a0b-bcda-608ce3bcf9e9 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35" status: 200 len: 1358 microversion: 2.1 time: 0.161552 Sep 06 22:55:49.390270 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 528/1062] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:55:49 2022] GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:55:50.412640 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-4edc995c-9577-4f7b-b37c-5dc6d06da8da tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:55:50.413277 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-4edc995c-9577-4f7b-b37c-5dc6d06da8da tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:55:50.420150 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4edc995c-9577-4f7b-b37c-5dc6d06da8da tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:50.420637 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4edc995c-9577-4f7b-b37c-5dc6d06da8da tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:50.421087 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4edc995c-9577-4f7b-b37c-5dc6d06da8da tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:50.421774 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4edc995c-9577-4f7b-b37c-5dc6d06da8da tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:50.422396 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4edc995c-9577-4f7b-b37c-5dc6d06da8da tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:50.423080 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-4edc995c-9577-4f7b-b37c-5dc6d06da8da tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:50.568983 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-4edc995c-9577-4f7b-b37c-5dc6d06da8da tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbf669e41524ef6a696bef77dab7080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9a2326d5c84ea8bcfc43d1ec1f1908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:55:50.578355 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-4edc995c-9577-4f7b-b37c-5dc6d06da8da tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35" status: 200 len: 1358 microversion: 2.1 time: 0.169176 Sep 06 22:55:50.578504 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 535/1063] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:55:50 2022] GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:55:50.591651 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-cb00c850-7d5c-418f-8e30-6d3716d252b9 req-4d866672-b78d-4d08-89c5-64e419a2b89f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "769031a7-c54b-4049-8faa-73ed46076c35", "name": "network-vif-plugged", "status": "completed", "tag": "1b6a0229-fbf1-4d69-b46b-a406a8ff714b"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:55:50.601537 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-cb00c850-7d5c-418f-8e30-6d3716d252b9 req-4d866672-b78d-4d08-89c5-64e419a2b89f service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:50.602010 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-cb00c850-7d5c-418f-8e30-6d3716d252b9 req-4d866672-b78d-4d08-89c5-64e419a2b89f service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:50.602494 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-cb00c850-7d5c-418f-8e30-6d3716d252b9 req-4d866672-b78d-4d08-89c5-64e419a2b89f service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:50.614484 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-cb00c850-7d5c-418f-8e30-6d3716d252b9 req-4d866672-b78d-4d08-89c5-64e419a2b89f service nova] Creating event network-vif-plugged:1b6a0229-fbf1-4d69-b46b-a406a8ff714b for instance 769031a7-c54b-4049-8faa-73ed46076c35 on hv-cinder-85220 Sep 06 22:55:50.619433 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-cb00c850-7d5c-418f-8e30-6d3716d252b9 req-4d866672-b78d-4d08-89c5-64e419a2b89f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175888 Sep 06 22:55:50.620005 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 529/1064] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 22:55:51.600680 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-76d2d85f-9473-497b-b646-e3b054585f34 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:55:51.601305 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-76d2d85f-9473-497b-b646-e3b054585f34 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:55:51.608499 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-76d2d85f-9473-497b-b646-e3b054585f34 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:51.609006 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-76d2d85f-9473-497b-b646-e3b054585f34 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:51.609439 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-76d2d85f-9473-497b-b646-e3b054585f34 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:51.610117 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-76d2d85f-9473-497b-b646-e3b054585f34 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:51.610564 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-76d2d85f-9473-497b-b646-e3b054585f34 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:51.610979 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-76d2d85f-9473-497b-b646-e3b054585f34 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:51.744897 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-76d2d85f-9473-497b-b646-e3b054585f34 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbf669e41524ef6a696bef77dab7080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9a2326d5c84ea8bcfc43d1ec1f1908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:55:51.752453 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-76d2d85f-9473-497b-b646-e3b054585f34 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35" status: 200 len: 1358 microversion: 2.1 time: 0.155652 Sep 06 22:55:51.753035 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 536/1065] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:55:51 2022] GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:55:52.776371 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-5ec349d7-3419-490b-aad8-78e46dba9b77 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:55:52.777091 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-5ec349d7-3419-490b-aad8-78e46dba9b77 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:55:52.784784 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ec349d7-3419-490b-aad8-78e46dba9b77 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:52.785286 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ec349d7-3419-490b-aad8-78e46dba9b77 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:52.785723 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ec349d7-3419-490b-aad8-78e46dba9b77 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:52.786407 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ec349d7-3419-490b-aad8-78e46dba9b77 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:52.786853 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ec349d7-3419-490b-aad8-78e46dba9b77 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:52.787341 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-5ec349d7-3419-490b-aad8-78e46dba9b77 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:52.914281 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-5ec349d7-3419-490b-aad8-78e46dba9b77 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbf669e41524ef6a696bef77dab7080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9a2326d5c84ea8bcfc43d1ec1f1908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:55:52.921871 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-5ec349d7-3419-490b-aad8-78e46dba9b77 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35" status: 200 len: 1547 microversion: 2.1 time: 0.150214 Sep 06 22:55:52.922427 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 530/1066] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:55:52 2022] GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35 => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:55:52.943671 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-5700b428-efb9-4c43-9fed-2038591fa0ad tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:55:52.944286 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-5700b428-efb9-4c43-9fed-2038591fa0ad tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:55:52.950994 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5700b428-efb9-4c43-9fed-2038591fa0ad tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:52.951467 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5700b428-efb9-4c43-9fed-2038591fa0ad tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:52.951895 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5700b428-efb9-4c43-9fed-2038591fa0ad tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:52.952576 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5700b428-efb9-4c43-9fed-2038591fa0ad tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:52.953041 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5700b428-efb9-4c43-9fed-2038591fa0ad tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:52.953457 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5700b428-efb9-4c43-9fed-2038591fa0ad tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:53.079403 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-5700b428-efb9-4c43-9fed-2038591fa0ad tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbf669e41524ef6a696bef77dab7080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9a2326d5c84ea8bcfc43d1ec1f1908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:55:53.087050 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-5700b428-efb9-4c43-9fed-2038591fa0ad tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35" status: 200 len: 1547 microversion: 2.1 time: 0.147198 Sep 06 22:55:53.087600 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 537/1067] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:55:52 2022] GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35 => generated 1547 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:55:53.109395 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9044dc78-25b8-478e-914f-1bee7f83b1bf tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:55:53.114725 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-9044dc78-25b8-478e-914f-1bee7f83b1bf tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8dbf669e41524ef6a696bef77dab7080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9a2326d5c84ea8bcfc43d1ec1f1908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:55:53.115428 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9044dc78-25b8-478e-914f-1bee7f83b1bf tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Searching by: {'deleted': False, 'project_id': '9b9a2326d5c84ea8bcfc43d1ec1f1908'} {{(pid=127088) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 22:55:53.122785 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9044dc78-25b8-478e-914f-1bee7f83b1bf tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:53.123251 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9044dc78-25b8-478e-914f-1bee7f83b1bf tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:53.123671 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9044dc78-25b8-478e-914f-1bee7f83b1bf tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:53.124381 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9044dc78-25b8-478e-914f-1bee7f83b1bf tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:53.124848 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9044dc78-25b8-478e-914f-1bee7f83b1bf tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:53.125271 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9044dc78-25b8-478e-914f-1bee7f83b1bf tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:53.213413 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.multi_cell_list [None req-9044dc78-25b8-478e-914f-1bee7f83b1bf tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127088) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 22:55:53.302950 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9044dc78-25b8-478e-914f-1bee7f83b1bf tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.197790 Sep 06 22:55:53.303528 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 531/1068] 10.222.0.39 () {58 vars in 1125 bytes} [Tue Sep 6 22:55:53 2022] GET /compute/v2.1/servers => generated 343 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:55:53.315854 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-42b2105b-1c41-4eef-b8be-c214e3d3db31 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:55:53.316454 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-42b2105b-1c41-4eef-b8be-c214e3d3db31 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:55:53.322264 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-42b2105b-1c41-4eef-b8be-c214e3d3db31 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:53.322735 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-42b2105b-1c41-4eef-b8be-c214e3d3db31 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:53.323188 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-42b2105b-1c41-4eef-b8be-c214e3d3db31 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:53.323865 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-42b2105b-1c41-4eef-b8be-c214e3d3db31 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:53.325032 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-42b2105b-1c41-4eef-b8be-c214e3d3db31 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:53.325448 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-42b2105b-1c41-4eef-b8be-c214e3d3db31 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:53.455269 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-42b2105b-1c41-4eef-b8be-c214e3d3db31 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbf669e41524ef6a696bef77dab7080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9a2326d5c84ea8bcfc43d1ec1f1908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:55:53.462717 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-42b2105b-1c41-4eef-b8be-c214e3d3db31 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35" status: 200 len: 1547 microversion: 2.1 time: 0.150617 Sep 06 22:55:53.463270 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 538/1069] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:55:53 2022] GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35 => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:55:55.012360 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-9f637a88-27ac-48fb-aeac-c303f7d5cfa9 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd97c3aa-fbde-4c7d-b021-9d43ce8b75e5"}} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:55:55.014558 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-9f637a88-27ac-48fb-aeac-c303f7d5cfa9 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:55:55.020864 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f637a88-27ac-48fb-aeac-c303f7d5cfa9 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:55.021341 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f637a88-27ac-48fb-aeac-c303f7d5cfa9 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:55.021761 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f637a88-27ac-48fb-aeac-c303f7d5cfa9 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:55.022446 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f637a88-27ac-48fb-aeac-c303f7d5cfa9 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:55:55.022885 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f637a88-27ac-48fb-aeac-c303f7d5cfa9 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:55:55.023296 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-9f637a88-27ac-48fb-aeac-c303f7d5cfa9 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:55:55.263759 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-9f637a88-27ac-48fb-aeac-c303f7d5cfa9 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "POST /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255804 Sep 06 22:55:55.264427 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 532/1070] 10.222.0.39 () {60 vars in 1323 bytes} [Tue Sep 6 22:55:55 2022] POST /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:56:01.793838 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-1b1aff16-fc69-4854-8525-a0dee0e17d18 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:56:01.794442 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-1b1aff16-fc69-4854-8525-a0dee0e17d18 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:56:01.801550 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1b1aff16-fc69-4854-8525-a0dee0e17d18 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:56:01.802026 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1b1aff16-fc69-4854-8525-a0dee0e17d18 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:56:01.802446 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1b1aff16-fc69-4854-8525-a0dee0e17d18 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:56:01.803122 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1b1aff16-fc69-4854-8525-a0dee0e17d18 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:56:01.803561 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1b1aff16-fc69-4854-8525-a0dee0e17d18 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:56:01.803973 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1b1aff16-fc69-4854-8525-a0dee0e17d18 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:56:01.936539 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-1b1aff16-fc69-4854-8525-a0dee0e17d18 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbf669e41524ef6a696bef77dab7080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9a2326d5c84ea8bcfc43d1ec1f1908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:56:01.944666 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-1b1aff16-fc69-4854-8525-a0dee0e17d18 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35" status: 200 len: 1593 microversion: 2.1 time: 0.155268 Sep 06 22:56:01.945241 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 539/1071] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:56:01 2022] GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35 => generated 1593 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:56:03.541399 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell0:SELECT=2 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:56:03.546320 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-f1fe2a51-d5cc-4d07-acb0-d3a4ec295342 req-18b550af-5f5d-41c5-acdb-1d79a77f4491 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "769031a7-c54b-4049-8faa-73ed46076c35", "tag": "1b6a0229-fbf1-4d69-b46b-a406a8ff714b"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:56:03.556232 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-f1fe2a51-d5cc-4d07-acb0-d3a4ec295342 req-18b550af-5f5d-41c5-acdb-1d79a77f4491 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:56:03.556710 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-f1fe2a51-d5cc-4d07-acb0-d3a4ec295342 req-18b550af-5f5d-41c5-acdb-1d79a77f4491 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:56:03.557179 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-f1fe2a51-d5cc-4d07-acb0-d3a4ec295342 req-18b550af-5f5d-41c5-acdb-1d79a77f4491 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:56:03.569637 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-f1fe2a51-d5cc-4d07-acb0-d3a4ec295342 req-18b550af-5f5d-41c5-acdb-1d79a77f4491 service nova] Creating event network-changed:1b6a0229-fbf1-4d69-b46b-a406a8ff714b for instance 769031a7-c54b-4049-8faa-73ed46076c35 on hv-cinder-85220 Sep 06 22:56:03.578166 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-f1fe2a51-d5cc-4d07-acb0-d3a4ec295342 req-18b550af-5f5d-41c5-acdb-1d79a77f4491 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038104 Sep 06 22:56:03.582395 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 533/1072] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:56:05.018840 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-243c99fa-111a-404d-b0ea-0c9405d4725f tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1307120940"}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:56:05.020057 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-243c99fa-111a-404d-b0ea-0c9405d4725f tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:56:05.022617 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:56:05.028254 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-243c99fa-111a-404d-b0ea-0c9405d4725f tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:56:05.028781 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-243c99fa-111a-404d-b0ea-0c9405d4725f tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:56:05.029223 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-243c99fa-111a-404d-b0ea-0c9405d4725f tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:56:05.029926 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-243c99fa-111a-404d-b0ea-0c9405d4725f tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:56:05.030372 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-243c99fa-111a-404d-b0ea-0c9405d4725f tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:56:05.030796 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-243c99fa-111a-404d-b0ea-0c9405d4725f tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:56:05.034520 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=65 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:56:05.256566 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.network.security_group_api [None req-243c99fa-111a-404d-b0ea-0c9405d4725f tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Adding security group b9bf731d-bf2e-4a96-bc8e-41d06046fe0c to port 1b6a0229-fbf1-4d69-b46b-a406a8ff714b Sep 06 22:56:05.874699 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-243c99fa-111a-404d-b0ea-0c9405d4725f tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "POST /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35/action" status: 202 len: 0 microversion: 2.1 time: 0.860213 Sep 06 22:56:05.883845 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-8f77d558-f252-4cfd-a66e-9296b0407e34 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:56:05.884546 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-8f77d558-f252-4cfd-a66e-9296b0407e34 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:56:05.887065 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:56:05.887410 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 540/1073] 10.222.0.39 () {60 vars in 1278 bytes} [Tue Sep 6 22:56:05 2022] POST /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35/action => generated 0 bytes in 865 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 22:56:05.892498 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-944e54d9-8001-49fc-abd8-282e844c46f0 req-321f6f3e-8baa-4ab6-9890-6f5c4ef7f2f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "769031a7-c54b-4049-8faa-73ed46076c35", "tag": "1b6a0229-fbf1-4d69-b46b-a406a8ff714b"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:56:05.905722 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f77d558-f252-4cfd-a66e-9296b0407e34 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:56:05.906472 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f77d558-f252-4cfd-a66e-9296b0407e34 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:56:05.906908 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f77d558-f252-4cfd-a66e-9296b0407e34 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:56:05.907627 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f77d558-f252-4cfd-a66e-9296b0407e34 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:56:05.911686 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-944e54d9-8001-49fc-abd8-282e844c46f0 req-321f6f3e-8baa-4ab6-9890-6f5c4ef7f2f5 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:56:05.912652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-944e54d9-8001-49fc-abd8-282e844c46f0 req-321f6f3e-8baa-4ab6-9890-6f5c4ef7f2f5 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:56:05.912652 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-944e54d9-8001-49fc-abd8-282e844c46f0 req-321f6f3e-8baa-4ab6-9890-6f5c4ef7f2f5 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:56:05.917322 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f77d558-f252-4cfd-a66e-9296b0407e34 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:56:05.917925 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-8f77d558-f252-4cfd-a66e-9296b0407e34 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:56:05.923167 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:56:05.931933 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-944e54d9-8001-49fc-abd8-282e844c46f0 req-321f6f3e-8baa-4ab6-9890-6f5c4ef7f2f5 service nova] Creating event network-changed:1b6a0229-fbf1-4d69-b46b-a406a8ff714b for instance 769031a7-c54b-4049-8faa-73ed46076c35 on hv-cinder-85220 Sep 06 22:56:05.938941 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-944e54d9-8001-49fc-abd8-282e844c46f0 req-321f6f3e-8baa-4ab6-9890-6f5c4ef7f2f5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050017 Sep 06 22:56:05.939878 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 541/1074] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:56:06.189827 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-8f77d558-f252-4cfd-a66e-9296b0407e34 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbf669e41524ef6a696bef77dab7080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9a2326d5c84ea8bcfc43d1ec1f1908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:56:06.198496 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-8f77d558-f252-4cfd-a66e-9296b0407e34 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35" status: 200 len: 1758 microversion: 2.1 time: 0.319275 Sep 06 22:56:06.200377 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 534/1075] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:56:05 2022] GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35 => generated 1758 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:56:23.196002 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=3 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:56:23.196739 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=5 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:56:23.201701 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-c03ccd30-4fab-4ebf-a2d4-70de2fead063 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:56:23.204088 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-c03ccd30-4fab-4ebf-a2d4-70de2fead063 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:56:23.210918 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c03ccd30-4fab-4ebf-a2d4-70de2fead063 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:56:23.211393 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c03ccd30-4fab-4ebf-a2d4-70de2fead063 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:56:23.211821 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c03ccd30-4fab-4ebf-a2d4-70de2fead063 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:56:23.212500 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c03ccd30-4fab-4ebf-a2d4-70de2fead063 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:56:23.212991 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c03ccd30-4fab-4ebf-a2d4-70de2fead063 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:56:23.213408 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c03ccd30-4fab-4ebf-a2d4-70de2fead063 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:56:23.282432 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-c03ccd30-4fab-4ebf-a2d4-70de2fead063 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "POST /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35/action" status: 202 len: 0 microversion: 2.1 time: 0.087772 Sep 06 22:56:23.283110 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 542/1076] 10.222.0.39 () {60 vars in 1278 bytes} [Tue Sep 6 22:56:23 2022] POST /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 22:56:23.292247 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e845e6ec-ea72-46e6-b3d2-858db54eb8bc tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:56:23.292891 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e845e6ec-ea72-46e6-b3d2-858db54eb8bc tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:56:23.295242 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=1 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:56:23.295991 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=5 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:56:23.302091 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e845e6ec-ea72-46e6-b3d2-858db54eb8bc tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:56:23.302855 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e845e6ec-ea72-46e6-b3d2-858db54eb8bc tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:56:23.304048 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e845e6ec-ea72-46e6-b3d2-858db54eb8bc tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:56:23.305011 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e845e6ec-ea72-46e6-b3d2-858db54eb8bc tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:56:23.305461 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e845e6ec-ea72-46e6-b3d2-858db54eb8bc tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:56:23.305876 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e845e6ec-ea72-46e6-b3d2-858db54eb8bc tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:56:23.558114 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e845e6ec-ea72-46e6-b3d2-858db54eb8bc tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbf669e41524ef6a696bef77dab7080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9a2326d5c84ea8bcfc43d1ec1f1908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:56:23.566258 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e845e6ec-ea72-46e6-b3d2-858db54eb8bc tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35" status: 200 len: 1750 microversion: 2.1 time: 0.278855 Sep 06 22:56:23.566821 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 535/1077] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:56:23 2022] GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35 => generated 1750 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:56:24.591541 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-b24c6881-9a40-42d5-bbec-466d754058b3 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:56:24.592226 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-b24c6881-9a40-42d5-bbec-466d754058b3 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:56:24.598273 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b24c6881-9a40-42d5-bbec-466d754058b3 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:56:24.598745 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b24c6881-9a40-42d5-bbec-466d754058b3 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:56:24.599164 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b24c6881-9a40-42d5-bbec-466d754058b3 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:56:24.599837 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b24c6881-9a40-42d5-bbec-466d754058b3 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:56:24.600276 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b24c6881-9a40-42d5-bbec-466d754058b3 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:56:24.600688 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-b24c6881-9a40-42d5-bbec-466d754058b3 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:56:24.741276 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-b24c6881-9a40-42d5-bbec-466d754058b3 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbf669e41524ef6a696bef77dab7080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9a2326d5c84ea8bcfc43d1ec1f1908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:56:24.749931 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-b24c6881-9a40-42d5-bbec-466d754058b3 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35" status: 200 len: 1755 microversion: 2.1 time: 0.163794 Sep 06 22:56:24.750486 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 543/1078] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:56:24 2022] GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:56:25.773615 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-b15f8545-0ac8-4d67-8a9b-d592e26591aa tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:56:25.774258 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-b15f8545-0ac8-4d67-8a9b-d592e26591aa tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:56:25.781116 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b15f8545-0ac8-4d67-8a9b-d592e26591aa tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:56:25.781597 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b15f8545-0ac8-4d67-8a9b-d592e26591aa tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:56:25.782027 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b15f8545-0ac8-4d67-8a9b-d592e26591aa tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:56:25.782708 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b15f8545-0ac8-4d67-8a9b-d592e26591aa tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:56:25.783155 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b15f8545-0ac8-4d67-8a9b-d592e26591aa tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:56:25.783574 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-b15f8545-0ac8-4d67-8a9b-d592e26591aa tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:56:25.926407 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-b15f8545-0ac8-4d67-8a9b-d592e26591aa tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbf669e41524ef6a696bef77dab7080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9a2326d5c84ea8bcfc43d1ec1f1908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:56:25.935155 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-b15f8545-0ac8-4d67-8a9b-d592e26591aa tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35" status: 200 len: 1755 microversion: 2.1 time: 0.165400 Sep 06 22:56:25.935719 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 536/1079] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:56:25 2022] GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:56:26.958726 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-6c52e3ff-dc0f-4532-8c5c-7de66df42466 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:56:26.959314 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-6c52e3ff-dc0f-4532-8c5c-7de66df42466 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:56:26.965959 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6c52e3ff-dc0f-4532-8c5c-7de66df42466 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:56:26.966429 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6c52e3ff-dc0f-4532-8c5c-7de66df42466 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:56:26.966850 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6c52e3ff-dc0f-4532-8c5c-7de66df42466 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:56:26.967533 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6c52e3ff-dc0f-4532-8c5c-7de66df42466 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:56:26.967972 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6c52e3ff-dc0f-4532-8c5c-7de66df42466 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:56:26.968384 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-6c52e3ff-dc0f-4532-8c5c-7de66df42466 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:56:27.107387 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-6c52e3ff-dc0f-4532-8c5c-7de66df42466 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbf669e41524ef6a696bef77dab7080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9a2326d5c84ea8bcfc43d1ec1f1908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:56:27.115679 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-6c52e3ff-dc0f-4532-8c5c-7de66df42466 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35" status: 200 len: 1755 microversion: 2.1 time: 0.160910 Sep 06 22:56:27.116228 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 544/1080] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:56:26 2022] GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:56:28.139339 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-e13be821-d3c5-4386-a306-062da8c9d1a6 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:56:28.139994 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-e13be821-d3c5-4386-a306-062da8c9d1a6 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:56:28.146316 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e13be821-d3c5-4386-a306-062da8c9d1a6 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:56:28.146799 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e13be821-d3c5-4386-a306-062da8c9d1a6 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:56:28.147223 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e13be821-d3c5-4386-a306-062da8c9d1a6 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:56:28.147902 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e13be821-d3c5-4386-a306-062da8c9d1a6 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:56:28.148345 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e13be821-d3c5-4386-a306-062da8c9d1a6 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:56:28.148778 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-e13be821-d3c5-4386-a306-062da8c9d1a6 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:56:28.291735 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-e13be821-d3c5-4386-a306-062da8c9d1a6 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbf669e41524ef6a696bef77dab7080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9a2326d5c84ea8bcfc43d1ec1f1908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:56:28.302294 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-e13be821-d3c5-4386-a306-062da8c9d1a6 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35" status: 200 len: 1755 microversion: 2.1 time: 0.166906 Sep 06 22:56:28.302866 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 537/1081] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:56:28 2022] GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:56:29.326112 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a1f68c5d-19c1-4924-9657-271a732f21f1 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:56:29.326758 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-a1f68c5d-19c1-4924-9657-271a732f21f1 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:56:29.333104 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a1f68c5d-19c1-4924-9657-271a732f21f1 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:56:29.333888 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a1f68c5d-19c1-4924-9657-271a732f21f1 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:56:29.334014 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a1f68c5d-19c1-4924-9657-271a732f21f1 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:56:29.334641 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a1f68c5d-19c1-4924-9657-271a732f21f1 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:56:29.335084 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a1f68c5d-19c1-4924-9657-271a732f21f1 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:56:29.335498 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a1f68c5d-19c1-4924-9657-271a732f21f1 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:56:29.477082 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-a1f68c5d-19c1-4924-9657-271a732f21f1 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbf669e41524ef6a696bef77dab7080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9a2326d5c84ea8bcfc43d1ec1f1908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:56:29.485224 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-a1f68c5d-19c1-4924-9657-271a732f21f1 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35" status: 200 len: 1755 microversion: 2.1 time: 0.163512 Sep 06 22:56:29.485781 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 545/1082] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:56:29 2022] GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:56:30.508874 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-00966cb9-9cd4-4f41-bb71-e5705fcc416d tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:56:30.509480 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-00966cb9-9cd4-4f41-bb71-e5705fcc416d tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:56:30.516010 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00966cb9-9cd4-4f41-bb71-e5705fcc416d tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:56:30.516476 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00966cb9-9cd4-4f41-bb71-e5705fcc416d tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:56:30.516938 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00966cb9-9cd4-4f41-bb71-e5705fcc416d tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:56:30.517612 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00966cb9-9cd4-4f41-bb71-e5705fcc416d tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:56:30.518057 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00966cb9-9cd4-4f41-bb71-e5705fcc416d tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:56:30.518466 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-00966cb9-9cd4-4f41-bb71-e5705fcc416d tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:56:30.661703 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-00966cb9-9cd4-4f41-bb71-e5705fcc416d tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbf669e41524ef6a696bef77dab7080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9a2326d5c84ea8bcfc43d1ec1f1908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:56:30.670302 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-00966cb9-9cd4-4f41-bb71-e5705fcc416d tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35" status: 200 len: 1755 microversion: 2.1 time: 0.165316 Sep 06 22:56:30.670868 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 538/1083] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:56:30 2022] GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:56:31.693797 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-c028bced-f7ee-4f9e-849a-cf2012beefa0 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:56:31.694385 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-c028bced-f7ee-4f9e-849a-cf2012beefa0 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:56:31.700951 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c028bced-f7ee-4f9e-849a-cf2012beefa0 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:56:31.701434 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c028bced-f7ee-4f9e-849a-cf2012beefa0 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:56:31.701864 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c028bced-f7ee-4f9e-849a-cf2012beefa0 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:56:31.702558 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c028bced-f7ee-4f9e-849a-cf2012beefa0 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:56:31.703009 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c028bced-f7ee-4f9e-849a-cf2012beefa0 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:56:31.703430 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-c028bced-f7ee-4f9e-849a-cf2012beefa0 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:56:31.844265 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-c028bced-f7ee-4f9e-849a-cf2012beefa0 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbf669e41524ef6a696bef77dab7080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9a2326d5c84ea8bcfc43d1ec1f1908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:56:31.852364 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-c028bced-f7ee-4f9e-849a-cf2012beefa0 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35" status: 200 len: 1755 microversion: 2.1 time: 0.162433 Sep 06 22:56:31.852950 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 546/1084] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:56:31 2022] GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:56:32.875617 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-643f4087-27ab-4795-b7bf-945e69d718a9 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:56:32.876220 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-643f4087-27ab-4795-b7bf-945e69d718a9 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:56:32.882541 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-643f4087-27ab-4795-b7bf-945e69d718a9 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:56:32.883010 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-643f4087-27ab-4795-b7bf-945e69d718a9 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:56:32.883436 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-643f4087-27ab-4795-b7bf-945e69d718a9 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:56:32.884113 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-643f4087-27ab-4795-b7bf-945e69d718a9 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:56:32.884559 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-643f4087-27ab-4795-b7bf-945e69d718a9 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:56:32.884999 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-643f4087-27ab-4795-b7bf-945e69d718a9 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:56:33.022658 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-643f4087-27ab-4795-b7bf-945e69d718a9 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbf669e41524ef6a696bef77dab7080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9a2326d5c84ea8bcfc43d1ec1f1908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:56:33.031450 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-643f4087-27ab-4795-b7bf-945e69d718a9 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35" status: 200 len: 1755 microversion: 2.1 time: 0.159848 Sep 06 22:56:33.032009 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 539/1085] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:56:32 2022] GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35 => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:56:34.054214 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-1d3b9892-8489-4381-b808-d7370610c95e tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:56:34.054821 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-1d3b9892-8489-4381-b808-d7370610c95e tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:56:34.062554 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1d3b9892-8489-4381-b808-d7370610c95e tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:56:34.063031 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1d3b9892-8489-4381-b808-d7370610c95e tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:56:34.063460 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1d3b9892-8489-4381-b808-d7370610c95e tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:56:34.064141 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1d3b9892-8489-4381-b808-d7370610c95e tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:56:34.064586 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1d3b9892-8489-4381-b808-d7370610c95e tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:56:34.065031 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-1d3b9892-8489-4381-b808-d7370610c95e tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:56:34.209381 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-1d3b9892-8489-4381-b808-d7370610c95e tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbf669e41524ef6a696bef77dab7080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9a2326d5c84ea8bcfc43d1ec1f1908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:56:34.218081 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-1d3b9892-8489-4381-b808-d7370610c95e tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35" status: 200 len: 1755 microversion: 2.1 time: 0.167819 Sep 06 22:56:34.218636 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 547/1086] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:56:34 2022] GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:56:35.241974 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-924571e4-757d-4bad-911c-aca5b343aa6c tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:56:35.242552 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-924571e4-757d-4bad-911c-aca5b343aa6c tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:56:35.249531 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-924571e4-757d-4bad-911c-aca5b343aa6c tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:56:35.250013 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-924571e4-757d-4bad-911c-aca5b343aa6c tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:56:35.250457 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-924571e4-757d-4bad-911c-aca5b343aa6c tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:56:35.251142 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-924571e4-757d-4bad-911c-aca5b343aa6c tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:56:35.251593 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-924571e4-757d-4bad-911c-aca5b343aa6c tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:56:35.252016 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-924571e4-757d-4bad-911c-aca5b343aa6c tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:56:35.401007 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-924571e4-757d-4bad-911c-aca5b343aa6c tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbf669e41524ef6a696bef77dab7080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9a2326d5c84ea8bcfc43d1ec1f1908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:56:35.409919 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-924571e4-757d-4bad-911c-aca5b343aa6c tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35" status: 200 len: 1758 microversion: 2.1 time: 0.171946 Sep 06 22:56:35.410487 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 540/1087] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:56:35 2022] GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35 => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:57:07.990492 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-58ba3e5c-05aa-4f7e-abdc-cfd89417ec9f tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1307120940"}} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:57:07.991120 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-58ba3e5c-05aa-4f7e-abdc-cfd89417ec9f tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:57:07.993185 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_api:SELECT=12 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:07.993835 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG dbcounter [-] [127087] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:08.000152 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-58ba3e5c-05aa-4f7e-abdc-cfd89417ec9f tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:57:08.000630 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-58ba3e5c-05aa-4f7e-abdc-cfd89417ec9f tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:57:08.001084 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-58ba3e5c-05aa-4f7e-abdc-cfd89417ec9f tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:57:08.001768 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-58ba3e5c-05aa-4f7e-abdc-cfd89417ec9f tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:57:08.002216 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-58ba3e5c-05aa-4f7e-abdc-cfd89417ec9f tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:57:08.002636 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-58ba3e5c-05aa-4f7e-abdc-cfd89417ec9f tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:57:08.132216 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.network.security_group_api [None req-58ba3e5c-05aa-4f7e-abdc-cfd89417ec9f tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Removing security group b9bf731d-bf2e-4a96-bc8e-41d06046fe0c from port 1b6a0229-fbf1-4d69-b46b-a406a8ff714b Sep 06 22:57:08.429591 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-58ba3e5c-05aa-4f7e-abdc-cfd89417ec9f tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "POST /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35/action" status: 202 len: 0 microversion: 2.1 time: 0.442071 Sep 06 22:57:08.429886 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 548/1088] 10.222.0.39 () {60 vars in 1278 bytes} [Tue Sep 6 22:57:07 2022] POST /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35/action => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 22:57:08.459950 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [req-48a10f51-d71d-4943-9acd-312595ed6f1d req-7be9a0df-cfb6-412c-b864-99b18973dc84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "769031a7-c54b-4049-8faa-73ed46076c35", "tag": "1b6a0229-fbf1-4d69-b46b-a406a8ff714b"}]} {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:57:08.475232 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_api:SELECT=12 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:08.477333 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG dbcounter [-] [127088] Writing DB stats nova_cell1:SELECT=36 {{(pid=127088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 22:57:08.486935 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-48a10f51-d71d-4943-9acd-312595ed6f1d req-7be9a0df-cfb6-412c-b864-99b18973dc84 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:57:08.487491 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-48a10f51-d71d-4943-9acd-312595ed6f1d req-7be9a0df-cfb6-412c-b864-99b18973dc84 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:57:08.487988 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [req-48a10f51-d71d-4943-9acd-312595ed6f1d req-7be9a0df-cfb6-412c-b864-99b18973dc84 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:57:08.518869 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.compute.server_external_events [req-48a10f51-d71d-4943-9acd-312595ed6f1d req-7be9a0df-cfb6-412c-b864-99b18973dc84 service nova] Creating event network-changed:1b6a0229-fbf1-4d69-b46b-a406a8ff714b for instance 769031a7-c54b-4049-8faa-73ed46076c35 on hv-cinder-85220 Sep 06 22:57:08.524216 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [req-48a10f51-d71d-4943-9acd-312595ed6f1d req-7be9a0df-cfb6-412c-b864-99b18973dc84 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067891 Sep 06 22:57:08.524988 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 541/1089] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:57:10.052310 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-d9f86601-3040-4551-99ba-8bda98bb7f58 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:57:10.052856 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-d9f86601-3040-4551-99ba-8bda98bb7f58 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:57:10.058676 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d9f86601-3040-4551-99ba-8bda98bb7f58 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:57:10.059149 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d9f86601-3040-4551-99ba-8bda98bb7f58 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:57:10.059573 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d9f86601-3040-4551-99ba-8bda98bb7f58 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:57:10.060256 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d9f86601-3040-4551-99ba-8bda98bb7f58 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:57:10.060693 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d9f86601-3040-4551-99ba-8bda98bb7f58 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:57:10.061136 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-d9f86601-3040-4551-99ba-8bda98bb7f58 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:57:10.149312 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.objects.instance [None req-d9f86601-3040-4551-99ba-8bda98bb7f58 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lazy-loading 'services' on Instance uuid 769031a7-c54b-4049-8faa-73ed46076c35 {{(pid=127087) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 22:57:10.221963 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-d9f86601-3040-4551-99ba-8bda98bb7f58 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "DELETE /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35/os-volume_attachments/bd97c3aa-fbde-4c7d-b021-9d43ce8b75e5" status: 202 len: 0 microversion: 2.1 time: 0.174157 Sep 06 22:57:10.222746 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 549/1090] 10.222.0.39 () {58 vars in 1416 bytes} [Tue Sep 6 22:57:10 2022] DELETE /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35/os-volume_attachments/bd97c3aa-fbde-4c7d-b021-9d43ce8b75e5 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 22:57:10.232202 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-0a12bfc4-a111-43fc-b058-fe32a5b0356f tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:57:10.234435 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-0a12bfc4-a111-43fc-b058-fe32a5b0356f tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:57:10.240786 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a12bfc4-a111-43fc-b058-fe32a5b0356f tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:57:10.241258 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a12bfc4-a111-43fc-b058-fe32a5b0356f tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:57:10.241730 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a12bfc4-a111-43fc-b058-fe32a5b0356f tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:57:10.242441 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a12bfc4-a111-43fc-b058-fe32a5b0356f tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:57:10.242875 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a12bfc4-a111-43fc-b058-fe32a5b0356f tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:57:10.243577 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-0a12bfc4-a111-43fc-b058-fe32a5b0356f tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:57:10.274989 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-0a12bfc4-a111-43fc-b058-fe32a5b0356f tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047946 Sep 06 22:57:10.275562 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 542/1091] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Sep 6 22:57:10 2022] GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:57:10.540086 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-46a66ccd-fae2-4426-8b9d-b10d2d3a6bb1 req-5f190fa8-6561-4ee1-ae8d-86061bbb5e9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "769031a7-c54b-4049-8faa-73ed46076c35", "tag": "1b6a0229-fbf1-4d69-b46b-a406a8ff714b"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:57:10.550814 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-46a66ccd-fae2-4426-8b9d-b10d2d3a6bb1 req-5f190fa8-6561-4ee1-ae8d-86061bbb5e9f service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:57:10.551289 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-46a66ccd-fae2-4426-8b9d-b10d2d3a6bb1 req-5f190fa8-6561-4ee1-ae8d-86061bbb5e9f service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:57:10.551712 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-46a66ccd-fae2-4426-8b9d-b10d2d3a6bb1 req-5f190fa8-6561-4ee1-ae8d-86061bbb5e9f service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:57:10.563657 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-46a66ccd-fae2-4426-8b9d-b10d2d3a6bb1 req-5f190fa8-6561-4ee1-ae8d-86061bbb5e9f service nova] Creating event network-changed:1b6a0229-fbf1-4d69-b46b-a406a8ff714b for instance 769031a7-c54b-4049-8faa-73ed46076c35 on hv-cinder-85220 Sep 06 22:57:10.568638 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-46a66ccd-fae2-4426-8b9d-b10d2d3a6bb1 req-5f190fa8-6561-4ee1-ae8d-86061bbb5e9f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032547 Sep 06 22:57:10.569263 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 550/1092] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 22:57:11.287809 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-d2e5cc46-7b47-497f-800d-6a44351cd2d1 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:57:11.289912 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-d2e5cc46-7b47-497f-800d-6a44351cd2d1 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:57:11.296940 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d2e5cc46-7b47-497f-800d-6a44351cd2d1 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:57:11.297420 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d2e5cc46-7b47-497f-800d-6a44351cd2d1 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:57:11.297851 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d2e5cc46-7b47-497f-800d-6a44351cd2d1 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:57:11.298532 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d2e5cc46-7b47-497f-800d-6a44351cd2d1 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:57:11.298979 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d2e5cc46-7b47-497f-800d-6a44351cd2d1 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:57:11.299395 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-d2e5cc46-7b47-497f-800d-6a44351cd2d1 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:57:11.327475 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-d2e5cc46-7b47-497f-800d-6a44351cd2d1 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043698 Sep 06 22:57:11.328026 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 543/1093] 10.222.0.39 () {58 vars in 1302 bytes} [Tue Sep 6 22:57:11 2022] GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 22:57:11.339458 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a4a3efbd-b9e8-4dbb-a80f-328f7b9d2279 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:57:11.340079 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-a4a3efbd-b9e8-4dbb-a80f-328f7b9d2279 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:57:11.346151 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a4a3efbd-b9e8-4dbb-a80f-328f7b9d2279 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:57:11.346621 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a4a3efbd-b9e8-4dbb-a80f-328f7b9d2279 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:57:11.347047 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a4a3efbd-b9e8-4dbb-a80f-328f7b9d2279 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:57:11.347724 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a4a3efbd-b9e8-4dbb-a80f-328f7b9d2279 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:57:11.348170 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a4a3efbd-b9e8-4dbb-a80f-328f7b9d2279 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:57:11.348586 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a4a3efbd-b9e8-4dbb-a80f-328f7b9d2279 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:57:11.424293 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-a4a3efbd-b9e8-4dbb-a80f-328f7b9d2279 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] HTTP exception thrown: Instance 769031a7-c54b-4049-8faa-73ed46076c35 is not attached to volume bd97c3aa-fbde-4c7d-b021-9d43ce8b75e5 Sep 06 22:57:11.426725 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a4a3efbd-b9e8-4dbb-a80f-328f7b9d2279 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Request method failure captured: Sep 06 22:57:11.426725 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: request: DELETE /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35/os-volume_attachments/bd97c3aa-fbde-4c7d-b021-9d43ce8b75e5 HTTP/1.1 Sep 06 22:57:11.426725 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept: application/json Sep 06 22:57:11.426725 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Sep 06 22:57:11.426725 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Connection: close Sep 06 22:57:11.426725 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Length: 0 Sep 06 22:57:11.426725 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Type: application/json Sep 06 22:57:11.426725 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Host: 10.222.0.39 Sep 06 22:57:11.426725 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Sep 06 22:57:11.426725 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.12 Sep 06 22:57:11.426725 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABjF8_XmrEV0ZTznJUpFUidVJ5_oklYnHjHLPnhHP0B4gXLHrhghvwXUuBdOYMdVKGWym6A8p8joVZ6gBdbVUl2CMfYrKCYsD9jO7qa2umFTgv_NNdQi0E4dwFOZWkNwDvZHh5nTNCNKBiv0-l5sUnKnZDsZ1P6swLAP262jSqWW9t3bYo Sep 06 22:57:11.426725 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Sep 06 22:57:11.426725 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Sep 06 22:57:11.426725 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Sep 06 22:57:11.426725 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Sep 06 22:57:11.426725 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Sep 06 22:57:11.426725 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Sep 06 22:57:11.426725 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Id: 9b9a2326d5c84ea8bcfc43d1ec1f1908 Sep 06 22:57:11.426725 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-TestMinimumBasicScenario-237630984 Sep 06 22:57:11.426725 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Role: reader,member Sep 06 22:57:11.426725 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Sep 06 22:57:11.428456 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9b9a2326d5c84ea8bcfc43d1ec1f1908"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9b9a2326d5c84ea8bcfc43d1ec1f1908"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9b9a2326d5c84ea8bcfc43d1ec1f1908"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9b9a2326d5c84ea8bcfc43d1ec1f1908"}]}] Sep 06 22:57:11.428456 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-TestMinimumBasicScenario-237630984 Sep 06 22:57:11.428456 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 9b9a2326d5c84ea8bcfc43d1ec1f1908 Sep 06 22:57:11.428456 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-TestMinimumBasicScenario-237630984 Sep 06 22:57:11.428456 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User: tempest-TestMinimumBasicScenario-237630984-project Sep 06 22:57:11.428456 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Sep 06 22:57:11.428456 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Sep 06 22:57:11.428456 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Id: 8dbf669e41524ef6a696bef77dab7080 Sep 06 22:57:11.428456 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-TestMinimumBasicScenario-237630984-project Sep 06 22:57:11.428456 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: method: > Sep 06 22:57:11.428456 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: exception: Instance 769031a7-c54b-4049-8faa-73ed46076c35 is not attached to volume bd97c3aa-fbde-4c7d-b021-9d43ce8b75e5 Sep 06 22:57:11.429351 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: action_args: {'server_id': '769031a7-c54b-4049-8faa-73ed46076c35', 'id': 'bd97c3aa-fbde-4c7d-b021-9d43ce8b75e5'} Sep 06 22:57:11.429351 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:57:11.429351 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:57:11.429351 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 06 22:57:11.429351 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 06 22:57:11.429351 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 22:57:11.429351 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 22:57:11.429351 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 06 22:57:11.429351 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 06 22:57:11.429351 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id bd97c3aa-fbde-4c7d-b021-9d43ce8b75e5. Sep 06 22:57:11.429351 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:57:11.429351 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:57:11.429351 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:57:11.429351 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:57:11.429351 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:57:11.429351 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:57:11.429351 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:57:11.429351 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:57:11.429351 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:57:11.430670 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:57:11.430670 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 06 22:57:11.430670 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 06 22:57:11.430670 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 769031a7-c54b-4049-8faa-73ed46076c35 is not attached to volume bd97c3aa-fbde-4c7d-b021-9d43ce8b75e5 Sep 06 22:57:11.430670 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:57:11.430670 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:57:11.430670 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:57:11.430670 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:57:11.430670 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:57:11.430670 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:57:11.430670 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:57:11.430670 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:57:11.430670 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 769031a7-c54b-4049-8faa-73ed46076c35 is not attached to volume bd97c3aa-fbde-4c7d-b021-9d43ce8b75e5 Sep 06 22:57:11.430670 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:57:11.430670 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a4a3efbd-b9e8-4dbb-a80f-328f7b9d2279 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Returning 404 to user: Instance 769031a7-c54b-4049-8faa-73ed46076c35 is not attached to volume bd97c3aa-fbde-4c7d-b021-9d43ce8b75e5 {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:57:11.431811 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-a4a3efbd-b9e8-4dbb-a80f-328f7b9d2279 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "DELETE /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35/os-volume_attachments/bd97c3aa-fbde-4c7d-b021-9d43ce8b75e5" status: 404 len: 154 microversion: 2.1 time: 0.093491 Sep 06 22:57:11.431811 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 551/1094] 10.222.0.39 () {58 vars in 1416 bytes} [Tue Sep 6 22:57:11 2022] DELETE /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35/os-volume_attachments/bd97c3aa-fbde-4c7d-b021-9d43ce8b75e5 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 22:57:12.567866 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-bd3594b6-3f23-4394-9ea1-a99dcfc8680c tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:57:12.568358 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bd3594b6-3f23-4394-9ea1-a99dcfc8680c tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:57:12.575327 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd3594b6-3f23-4394-9ea1-a99dcfc8680c tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:57:12.575804 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd3594b6-3f23-4394-9ea1-a99dcfc8680c tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:57:12.576229 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd3594b6-3f23-4394-9ea1-a99dcfc8680c tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:57:12.576990 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd3594b6-3f23-4394-9ea1-a99dcfc8680c tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:57:12.577419 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd3594b6-3f23-4394-9ea1-a99dcfc8680c tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:57:12.577834 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-bd3594b6-3f23-4394-9ea1-a99dcfc8680c tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:57:12.601578 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-bd3594b6-3f23-4394-9ea1-a99dcfc8680c tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Going to try to terminate instance {{(pid=127088) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 22:57:12.674783 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-bd3594b6-3f23-4394-9ea1-a99dcfc8680c tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "DELETE /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35" status: 204 len: 0 microversion: 2.1 time: 0.110242 Sep 06 22:57:12.675363 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 544/1095] 10.222.0.39 () {58 vars in 1239 bytes} [Tue Sep 6 22:57:12 2022] DELETE /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 22:57:12.684310 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-a5fc1b2c-ac1e-469f-91ab-70ae9ed088b8 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:57:12.684951 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-a5fc1b2c-ac1e-469f-91ab-70ae9ed088b8 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:57:12.691185 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a5fc1b2c-ac1e-469f-91ab-70ae9ed088b8 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:57:12.691654 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a5fc1b2c-ac1e-469f-91ab-70ae9ed088b8 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:57:12.692079 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a5fc1b2c-ac1e-469f-91ab-70ae9ed088b8 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:57:12.692752 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a5fc1b2c-ac1e-469f-91ab-70ae9ed088b8 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:57:12.693245 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a5fc1b2c-ac1e-469f-91ab-70ae9ed088b8 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:57:12.693658 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-a5fc1b2c-ac1e-469f-91ab-70ae9ed088b8 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:57:12.826686 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.policy [None req-a5fc1b2c-ac1e-469f-91ab-70ae9ed088b8 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbf669e41524ef6a696bef77dab7080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9a2326d5c84ea8bcfc43d1ec1f1908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127087) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:57:12.834270 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-a5fc1b2c-ac1e-469f-91ab-70ae9ed088b8 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35" status: 200 len: 1553 microversion: 2.1 time: 0.154603 Sep 06 22:57:12.834813 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 552/1096] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:57:12 2022] GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 22:57:13.856953 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-4b38198d-35fb-4b59-a4c0-c5ae17b9025c tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:57:13.857647 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-4b38198d-35fb-4b59-a4c0-c5ae17b9025c tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:57:13.864148 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4b38198d-35fb-4b59-a4c0-c5ae17b9025c tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:57:13.864636 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4b38198d-35fb-4b59-a4c0-c5ae17b9025c tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:57:13.865100 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4b38198d-35fb-4b59-a4c0-c5ae17b9025c tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:57:13.865796 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4b38198d-35fb-4b59-a4c0-c5ae17b9025c tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:57:13.866278 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4b38198d-35fb-4b59-a4c0-c5ae17b9025c tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:57:13.866701 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-4b38198d-35fb-4b59-a4c0-c5ae17b9025c tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:57:13.994229 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-4b38198d-35fb-4b59-a4c0-c5ae17b9025c tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbf669e41524ef6a696bef77dab7080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9a2326d5c84ea8bcfc43d1ec1f1908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:57:14.002493 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-4b38198d-35fb-4b59-a4c0-c5ae17b9025c tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35" status: 200 len: 1553 microversion: 2.1 time: 0.149935 Sep 06 22:57:14.003068 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 545/1097] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:57:13 2022] GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:57:14.795722 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [req-7fdf911b-352b-404e-9c85-6549f7fdf118 req-eeca3df1-cd9d-4ec7-8751-22beab130cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "769031a7-c54b-4049-8faa-73ed46076c35", "name": "network-vif-deleted", "tag": "1b6a0229-fbf1-4d69-b46b-a406a8ff714b"}]} {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 22:57:14.801556 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 22:57:14.801751 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Tue Sep 6 22:57:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.39) !!! Sep 06 22:57:14.807885 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-7fdf911b-352b-404e-9c85-6549f7fdf118 req-eeca3df1-cd9d-4ec7-8751-22beab130cc8 service nova] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:57:14.808678 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-7fdf911b-352b-404e-9c85-6549f7fdf118 req-eeca3df1-cd9d-4ec7-8751-22beab130cc8 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:57:14.809143 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [req-7fdf911b-352b-404e-9c85-6549f7fdf118 req-eeca3df1-cd9d-4ec7-8751-22beab130cc8 service nova] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:57:14.821259 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.compute.server_external_events [req-7fdf911b-352b-404e-9c85-6549f7fdf118 req-eeca3df1-cd9d-4ec7-8751-22beab130cc8 service nova] Creating event network-vif-deleted:1b6a0229-fbf1-4d69-b46b-a406a8ff714b for instance 769031a7-c54b-4049-8faa-73ed46076c35 on hv-cinder-85220 Sep 06 22:57:14.826807 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [req-7fdf911b-352b-404e-9c85-6549f7fdf118 req-eeca3df1-cd9d-4ec7-8751-22beab130cc8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035391 Sep 06 22:57:14.828435 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 553/1098] 10.222.0.39 () {64 vars in 1317 bytes} [Tue Sep 6 22:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 22:57:15.027053 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7460b75c-c448-4c00-92da-c787496e90ed tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:57:15.027594 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.compute.api [None req-7460b75c-c448-4c00-92da-c787496e90ed tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127088) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:57:15.029955 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 22:57:15.030099 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: Tue Sep 6 22:57:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35 (ip 10.222.0.39) !!! Sep 06 22:57:15.037649 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7460b75c-c448-4c00-92da-c787496e90ed tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:57:15.038119 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7460b75c-c448-4c00-92da-c787496e90ed tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:57:15.038551 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7460b75c-c448-4c00-92da-c787496e90ed tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:57:15.039233 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7460b75c-c448-4c00-92da-c787496e90ed tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:57:15.039675 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7460b75c-c448-4c00-92da-c787496e90ed tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:57:15.040087 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7460b75c-c448-4c00-92da-c787496e90ed tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:57:15.070682 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7460b75c-c448-4c00-92da-c787496e90ed tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:57:15.071158 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7460b75c-c448-4c00-92da-c787496e90ed tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:57:15.071584 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG oslo_concurrency.lockutils [None req-7460b75c-c448-4c00-92da-c787496e90ed tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127088) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:57:15.072022 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.objects.instance [None req-7460b75c-c448-4c00-92da-c787496e90ed tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lazy-loading 'fault' on Instance uuid 769031a7-c54b-4049-8faa-73ed46076c35 {{(pid=127088) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 22:57:15.115057 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.policy [None req-7460b75c-c448-4c00-92da-c787496e90ed tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dbf669e41524ef6a696bef77dab7080', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9a2326d5c84ea8bcfc43d1ec1f1908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127088) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 22:57:15.122946 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7460b75c-c448-4c00-92da-c787496e90ed tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35" status: 200 len: 1348 microversion: 2.1 time: 0.100335 Sep 06 22:57:15.123521 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 546/1099] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:57:15 2022] GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35 => generated 1348 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 22:57:16.147363 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-5b4657e8-37f3-4a51-82d6-8dd4d090022b tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '>' {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:57:16.148047 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.compute.api [None req-5b4657e8-37f3-4a51-82d6-8dd4d090022b tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] [instance: 769031a7-c54b-4049-8faa-73ed46076c35] Fetching instance by UUID {{(pid=127087) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 22:57:16.154729 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5b4657e8-37f3-4a51-82d6-8dd4d090022b tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:57:16.155403 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5b4657e8-37f3-4a51-82d6-8dd4d090022b tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:57:16.156086 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5b4657e8-37f3-4a51-82d6-8dd4d090022b tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:57:16.156778 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5b4657e8-37f3-4a51-82d6-8dd4d090022b tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Acquiring lock "2c8ddd81-1531-42c9-950d-068e09646658" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 22:57:16.157228 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5b4657e8-37f3-4a51-82d6-8dd4d090022b tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 06 22:57:16.157658 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG oslo_concurrency.lockutils [None req-5b4657e8-37f3-4a51-82d6-8dd4d090022b tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Lock "2c8ddd81-1531-42c9-950d-068e09646658" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 06 22:57:16.170791 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.wsgi [None req-5b4657e8-37f3-4a51-82d6-8dd4d090022b tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] HTTP exception thrown: Instance 769031a7-c54b-4049-8faa-73ed46076c35 could not be found. Sep 06 22:57:16.172384 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-5b4657e8-37f3-4a51-82d6-8dd4d090022b tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Request method failure captured: Sep 06 22:57:16.172384 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: request: GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35 HTTP/1.1 Sep 06 22:57:16.172384 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept: application/json Sep 06 22:57:16.172384 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Accept-Encoding: identity Sep 06 22:57:16.172384 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Connection: close Sep 06 22:57:16.172384 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Length: 0 Sep 06 22:57:16.172384 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Content-Type: application/json Sep 06 22:57:16.172384 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Host: 10.222.0.39 Sep 06 22:57:16.172384 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: Openstack-System-Scope: None Sep 06 22:57:16.172384 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: User-Agent: python-urllib3/1.26.12 Sep 06 22:57:16.172384 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Auth-Token: gAAAAABjF8_XmrEV0ZTznJUpFUidVJ5_oklYnHjHLPnhHP0B4gXLHrhghvwXUuBdOYMdVKGWym6A8p8joVZ6gBdbVUl2CMfYrKCYsD9jO7qa2umFTgv_NNdQi0E4dwFOZWkNwDvZHh5nTNCNKBiv0-l5sUnKnZDsZ1P6swLAP262jSqWW9t3bYo Sep 06 22:57:16.172384 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Id: None Sep 06 22:57:16.172384 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Domain-Name: None Sep 06 22:57:16.172384 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Identity-Status: Confirmed Sep 06 22:57:16.172384 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Is-Admin-Project: True Sep 06 22:57:16.172384 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Id: default Sep 06 22:57:16.172384 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Domain-Name: Default Sep 06 22:57:16.172384 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Id: 9b9a2326d5c84ea8bcfc43d1ec1f1908 Sep 06 22:57:16.172384 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Project-Name: tempest-TestMinimumBasicScenario-237630984 Sep 06 22:57:16.172384 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Role: reader,member Sep 06 22:57:16.172384 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Roles: reader,member Sep 06 22:57:16.174197 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9b9a2326d5c84ea8bcfc43d1ec1f1908"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9b9a2326d5c84ea8bcfc43d1ec1f1908"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9b9a2326d5c84ea8bcfc43d1ec1f1908"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9b9a2326d5c84ea8bcfc43d1ec1f1908"}]}] Sep 06 22:57:16.174197 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant: tempest-TestMinimumBasicScenario-237630984 Sep 06 22:57:16.174197 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Id: 9b9a2326d5c84ea8bcfc43d1ec1f1908 Sep 06 22:57:16.174197 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-Tenant-Name: tempest-TestMinimumBasicScenario-237630984 Sep 06 22:57:16.174197 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User: tempest-TestMinimumBasicScenario-237630984-project Sep 06 22:57:16.174197 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Id: default Sep 06 22:57:16.174197 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Domain-Name: Default Sep 06 22:57:16.174197 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Id: 8dbf669e41524ef6a696bef77dab7080 Sep 06 22:57:16.174197 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: X-User-Name: tempest-TestMinimumBasicScenario-237630984-project Sep 06 22:57:16.174197 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: method: > Sep 06 22:57:16.174197 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: exception: Instance 769031a7-c54b-4049-8faa-73ed46076c35 could not be found. Sep 06 22:57:16.174197 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: action_args: {'id': '769031a7-c54b-4049-8faa-73ed46076c35'} Sep 06 22:57:16.175266 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: {{(pid=127087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 22:57:16.175266 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:57:16.175266 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 22:57:16.175266 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 22:57:16.175266 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 22:57:16.175266 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 22:57:16.175266 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 22:57:16.175266 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 22:57:16.175266 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 22:57:16.175266 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 22:57:16.175266 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 769031a7-c54b-4049-8faa-73ed46076c35 could not be found. Sep 06 22:57:16.175266 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:57:16.175266 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:57:16.175266 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:57:16.175266 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:57:16.175266 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:57:16.175266 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:57:16.175266 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 22:57:16.175266 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 22:57:16.175266 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 22:57:16.177021 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 22:57:16.177021 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 22:57:16.177021 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 22:57:16.177021 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 22:57:16.177021 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 22:57:16.177021 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 22:57:16.177021 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 22:57:16.177021 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 769031a7-c54b-4049-8faa-73ed46076c35 could not be found. Sep 06 22:57:16.177021 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:57:16.177021 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 22:57:16.177021 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:57:16.177021 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 22:57:16.177021 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 22:57:16.177021 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 22:57:16.177021 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 22:57:16.177021 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 22:57:16.177021 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 769031a7-c54b-4049-8faa-73ed46076c35 could not be found. Sep 06 22:57:16.177021 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: ERROR nova.api.openstack.wsgi Sep 06 22:57:16.178521 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: DEBUG nova.api.openstack.wsgi [None req-5b4657e8-37f3-4a51-82d6-8dd4d090022b tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Returning 404 to user: Instance 769031a7-c54b-4049-8faa-73ed46076c35 could not be found. {{(pid=127087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 22:57:16.178521 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: INFO nova.api.openstack.requestlog [None req-5b4657e8-37f3-4a51-82d6-8dd4d090022b tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35" status: 404 len: 111 microversion: 2.1 time: 0.031070 Sep 06 22:57:16.178521 dv-cinder-852208-20-iscsi devstack@n-api.service[127087]: [pid: 127087|app: 0|req: 554/1100] 10.222.0.39 () {58 vars in 1236 bytes} [Tue Sep 6 22:57:16 2022] GET /compute/v2.1/servers/769031a7-c54b-4049-8faa-73ed46076c35 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 22:57:16.182421 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: DEBUG nova.api.openstack.wsgi [None req-7fca1f5c-5f84-42a7-9e4f-a317750952a9 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] Calling method '.version_select at 0x7f9c4f7e1790>' {{(pid=127088) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 22:57:16.202298 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: INFO nova.api.openstack.requestlog [None req-7fca1f5c-5f84-42a7-9e4f-a317750952a9 tempest-TestMinimumBasicScenario-237630984 tempest-TestMinimumBasicScenario-237630984-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-109505324" status: 202 len: 0 microversion: 2.1 time: 0.023658 Sep 06 22:57:16.202847 dv-cinder-852208-20-iscsi devstack@n-api.service[127088]: [pid: 127088|app: 0|req: 547/1101] 10.222.0.39 () {58 vars in 1269 bytes} [Tue Sep 6 22:57:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-109505324 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)